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ABSTRACT 

Some new results in the scheduling of dynamic multi- 
commodity flows in data communication networks are presented. 

A new performance measure for effective delivery of back- 
logged data to their destinations is defined and the solution 
to the resulting delivery problem is obtained through a se- 
quential linear optimization methodology. Properties of an 
optimal dynamic multicommodity flow schedule are studied in 
detail, taking advantage where possible of the linear pro- 
gramming formulation. The special case of the delivery 
problem in a single destination network also is analyzed. 

Application of the results to stochastic delivery prob- 
lems in which the data inputs to the network are modelled as 
Poisson processes is addressed, and a new dynamic data com- 
munication network analysis is presented. 

Finally, the delivery problem on networks with capacitated 
links and with traversal delays is considered and some new 
results obtained. 
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INTRODUCTION 



I . 

A. MOTIVATION 

The design of data communication networks has received 
much attention during the past decade and the interest in 
this field is constantly growing. This fact is explained by 
the rapidly expanding role being played by data processing 
in today's society and the apparent advantage in sharing power- 
ful computational resources . 

The overall subject of data communication networks can be 
looked upon from many different points of view, each repre- 
senting an intellectually challenging problem. Just to name 
two: there is the problem of cost effective topological net- 

work design and there is the problem of determining, in a given 
network, the routes which data should follow from their source 
to their destination. The problem of assigning routes has 
been one of the most intensively studied areas in the field 
of data communication networks. 

It is possible to view the complete routing problem as com- 
posed of two parts: the first, calculation of routing assign- 

ments and second, their implementation in an actual data 
routing control strategy in a real, basically stochastic, net- 
work environment. It is the first part that we are mostly con- 
cerned with in this research, although we touch briefly on the 
other . 

A network model for calculating routing assignments can 
be roughly classified as static or dynamic. These reflect the 
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long and the short term stochastic behavior of a network, 
respectively. A finer taxonomy is possible, regarding the 
frequency with which a routing assignment has to be recomputed 
to support efficient communication. A desirable complete rout- 
ing methodology must provide fast adaptation to a changing net- 
work environment and be stable at the same time. It should 
be dead-lock free as well as distributed to minimize computa- 
tional complexity and control information flows. Clearly, there 
are substantial difficulties in achieving all these attributes 
simultaneously or even in qualifying trade-off relations among 
them. 

In spite of the progress made in some areas, and in par- 
ticular in the computation of static routing assignments, many 
basic questions remain unanswered. For example, definition of 
a meaningful performance measure for dynamic routing assignments 
which will give rise to mathematically tractable problem formu- 
lation, seems to have been missing. Thus, it appears that new 
insight into the relationships that make up a dynamic network 
model should be helpful in coping with these questions. The 
new conceptual ideas and analytic tools for studying them 
introduced in this research are a step in this direction. 

B. SURVEY OF PREVIOUS WORK 

In [15] Kleinrock introduced an analytical model of a data 
communication network. Many algorithms use this model to com- 
pute routing assignments, for example, the algorithms due to 
Cantor and Gerla [17], Fratta, Gerla and Kleinrock [16] and 
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Defenderfer [18] . In all those algorithms the steady-state 
delay of messages in each link is calculated explicitly as 



where : 

^ii : '' s ^ a1:a fl° w rate in link [i,j] (messages/ 

J second) ; 

c ij ; '' s ca P ac ity of link [i,j] (messages/second); 

t^. is the expected delay/message experienced by 

all messages using that link. 

A routing assignment is selected to minimize the expected weighted 
delay T, 



rp — 



I 

[i,j] 



f . . t . . 
ID ID 



of messages traversing the network. This analysis is based on 
the assumption that message arrivals to each link can be con- 
sidered as Poisson process with independent, exponentially 
distributed, message length, which requires Kleinrock 1 s famous 
"independence assumption" that messages "lose their identity" 
at each node and are assigned new independent lengths. 

All the algorithms referenced thus far exploit the convexity 
of the objective function. A different approach, leading to 
a linear problem formulation, was suggested by Wozencraft in 
[29]. Instead of minimizing the average expected delay, the 
objective is to minimize the maximal saturation ratio 
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in the network. Subsequently the next maximal saturation ratio 
is minimized, etc. This Min-Max policy was extensively studied 
by Ros [8] and as a result considerable insight into the problem 
of static routing was gained. One of the objectives of this 
research is to study possible generalization of the Min-Max 
approach and in particular its sequential character to deal with 
dynamic network models. 

Kleinrock's steady-state and independence assumptions make 
his model appropriate to describe long term stochastic behavior 
of a data communication model, but less applicable for computa- 
tion of dynamic routing assignments. 

One of the most important efforts in the direction of find- 
ing a more appropriate model for describing network dynamics 
was proposed by Segall [1] . His approach is to view the con- 
tents of data queues at the network nodes in a continuous state 
space setting rather than as an integer number of messages or 
bits. The continuous nature of the state is justified by 
recognizing that any individual message contributes very little 
to the overall behavior of a network. Having established the 
model, Segall expresses the dynamic routing assignment problem 
as a linear-optimal control problem for which a close-loop solu- 
tion is sought. This formulation has been used to investigate 
how to minimize 

^*f 

D = / ( l q^(t))dt 

t Q (i,k) 

where : 
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is some time at which all queues are empty; 

q^(t) is the queue size at node i of data destined to 
node k, at time t. 

Here D is the total delay experienced by the queued messages 
during the period [tQ,t^] r during which all the queued data 
are to be delivered to their destinations. 

The solution to this problem is approached by means of 
the minimum principle of Pontryagin [30], since this principle 
provides not only necessary but also sufficient condition for 
optimality in that case. A comprehensive set of principles 
describing the closed loop solution has been obtained by Moss 
[2] for the case in which all backlogged data have the same 
destination and the input to the network is continuous and con- 
stant. Additional study of the single destination case is pro- 
vided in [11] and [31]. Unfortunately the optimal control 
approach runs into difficulties when the general, multicommodity 
case is considered and no general solution has yet been obtained. 

C. SYNOPSIS OF THESIS 

To cope with the difficulties posed by the multicommodity 
dynamic routing assignment problem, a different approach is 
taken in this research. It involves a change in the perform- 
ance measure. Rather than trying to minimize the total delay 
experienced by the backlogged data, the concept is to deliver 
all of that data to their destinations in the shortest time 
possible. Since eventually there are many dynamic routing 
assignments that can do so, one which maximizes the total amount 
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of delivered data over time, is selected. We refer to this 
problem formulation as the "delivery problem" and to the corres- 
ponding dynamic routing assignment as the "flow schedule." 

There are several advantages associated with the above state- 
ment of the delivery problem. Most important is the ability 
to find the desired flow schedule by solving a sequence of 
hierarchically related linear programs. Also, it turns out 
that the new performance measure reveals some structural proper- 
ties that bring new insight to the problem of dynamic flow 
scheduling. The main purpose of this research is to study those 
properties in detail. 

The new performance measure (we call it the "delivery func- 
tion") and related optimality criterion are explained in Ch. II. 
Also, by introducing a concept of "global optimality" we are 
able to relate the optimal delivery function to the "total de- 
lay" criterion. In Ch. II we also introduce the basic network 
model and the notational convention to be used throughout the 
thesis . 

In Ch . Ill a solution algorithm to the delivery problem 
is presented. It consists of solving a sequence of hierarchi- 
cally related linear programs. In principle, each linear 
program that is solved contracts the space of remaining feasible 
flow schedules, until finally an optimal piecewise constant 
flow schedule is obtained. The optimality of the resulting 
flow schedule is formally derived in Ch. Ill using some basic 
results regarding the properties of feasible flow schedules. 

In Ch. IV we study in detail the structural properties of 
an optimal flow schedule. By exploiting various properties of 
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linear programming we are able to derive several results that 
characterize an optimal flow schedule. One key result is the 
description of critical sets of commodities and the capacity 
resources (links) they must saturate for various periods of 
time. Also, the properties of those saturating flows, and in 
particular their total rates, are determined. In this chapter 
the important idea of optimal solution "stability" is intro- 
duced, which allows one to express most of the above properties 
in terms of the optimal dual variables associated with the 
linear programs of the solution algorithm. 

We devote Ch . V to discussion of the single destination 
network. The solution algorithm of Ch. Ill is specialized to 
handle this case. Considerable additional simplifications are 
obtained by observing that the single destination delivery 
problem may be interpreted as a single commodity flow problem 
so that advantage may be taken of many well established results 
The concept of stability is revised and exploited as part of 
the solution algorithm. 

Continuing the discussion from Ch. II we show that the opti- 
mal single destination flow schedule is also globally optimal 
and thus also solves the single destination "minimal total de- 
lay problem" [11] . The computational advantages of the new 
algorithm are addressed briefly. 

In Ch. VI we analyze the stochastic delivery problem. Here 
in addition to the backlogged data considered so far, we are 
concerned with Poisson arrivals of messages to the network. 
Following Yee [12] the expected minimal time to empty an M/M/1 
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queueing system is taken to be the new performance measure. 

It is shown that the theory of dynamic flow scheduling, derived 
earlier for the deterministic case, and in particular the se- 
quential linear optimization methodology, can be applied (at 
least, in principle) to solve the stochastic .delivery problem. 

In Ch. VII we consider a more general setting for a de- 
livery problem. Here we associate with each link a traversal 
delay, in addition to a capacity constraint. Although it would 
be possible to continue our discussion within the context of 
data communication networks , it is more natural to choose the 
transportation problem as the framework for our investigation. 
This allows a generalization of link capacity constraints to 
include loading and unloading constraints. The addition of 
traversal delays greatly complicates the delivery problem. 

It is possible, however, to exhibit a (conceptually) simple 
solution procedure for the case of bi-partite transportation 
networks . A discrete time approximation for general network 
models also is discussed and a particular example of military 
application is presented. 

In Ch. VIII we summarize the most important results of 
this research and indicate areas for future study. 

Finally, we defer to the Appendix a number of proofs, 
examples and short discussions which would tend to blur the 
main ideas if left within the body of the thesis. 
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II. PROBLEM FORMULATION 



A. COMMUNICATION NETWORK MODEL 

1 . Topological Representations 

A data communication network may be modelled as a set 
of nodes interconnected by a number of links. The nodes repre- 
sent physical locations at which data may enter or exit the 
network and the links represent unidirectional channels over 
which data is transmitted from node to node. A typical data 
communication model is shown in Fig. II. 1. 




Fig. II. 1. Communication Network 

With each link we associate a channel capacity which indicates 
the upper bound on the data flow rate for that channel . Wj.th 
each node we associate, at every instant of time, the amounts 
of data awaiting transmission to each destination at the corres- 
ponding location. The collection of node descriptors _or all 
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the nodes in the network constitutes the state of the system, 
or equivalently, system congestion at any given time t. 

We will say that any data in the network is commodity 

(i t_ k) if its origin (entry node) was node i and its final 

destination (exit node) is node k. We shall also say that any 
data in the network is commodity k if its final destination is 
node k. 

Consider a data communication network G(V,Lq), where 
V = {l,2,...,n} is a set of n nodes and L Q = { [ i , j ] } is a set 
of links. By the notation [ i , j ] we mean the link that con- 
nects node i to node j , in that direction. We will also use 

the notation Lq = {1,2 ,...,£} and denote an element of Lq by 
e. If link e corresponds to link [i,j] then h(e) = i and 
t(e) = j. We say that node i can communicate to node k iff 
there is at least one directed chain of links going form node 
i to node k. We also define: 



N 



0 



set {(i,k)} of node pairs such that node i can 
communicate to node k, i ^ k. 




amount of commodity k, stored in node i at time t, 
v(i,k) s N q . 




flow rate of commodity k on link [i,j] at time t, 
v[i,j] s L q and v(i,k) £ N Q . 



capacity of link [i,j], ‘■‘[i/jl e . 



k , . . 
a i (t) 



flow rate of commodity k arriving at node i from 
outside the network, at time t, v(i,k) £ Nq . 



h — head, t — tail h(e) -* t(e) 
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vve reserve the use of respective capital letters for sets and 
vector notation, interchangeably. For example, 

F(t) = (f 12 ^ *") ' f 13 ( t) , • • • , f^j ( t) • . • ) denotes a vector (set) 
of flows. 

2 • Dynamic System Equations and Constraints 

The flows and the queues just defined must satisfy three 
basic constraints: non-negativity, conservation and capacity. 

The non-negativity constraint states that 

f ij(t) >_ 0 , V[i,j] £ L 0 , v(i,k) £ N 0 and *t. (II. 1 ) 

The conservation constraint may be written as 

if q*(t) > 0, 

otherwise , 

*(i,k) e N q and ^t. (II. 2 ) 

Constraint (II. 2 ) accounts for the fact that at all times the 
amount of any commodity stored at any node is a non-negative 
quantity. Moreover, the fact that the net delivery rate of 

k 

commodity k from node i is non-negative, r^(t) >_ 0, ^(i,k) e N Q 
and vt , implies that data is not stored at intermediate nodes 
en route from its entry node to its exit node in the network. 



r*(t) 4 l f * (t ) 
1 j(*i) 1D 



l f ii < 
j(^i) 3 



1 a i (t) , 



= a i ( t) , 



Intermediate storage of commodities is discussed in 
Appendix C. 
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Finally , the capacity constraint is 




c ± y * [i , j ] e L q and *t (II. 3) 



where f ^ ^ ( t ) denotes the aggregate flow rate on link [i,j] at 
time t. 

Definition (II. 1) . 

A set of flows F(t) , tg <_ t £ t^ is a feasible multicommodity 
flow schedule if it satisfies constraints ( II . 1) - ( II . 3 ) for all 



We will assume, for mathematical convenience, that data input 
flow rates are identically zero during the time interval under 
consideration, i.e. 



In Ch . VI the behavior of a communication network in a stochas- 



be interpreted as a rate of a Poisson process. 

We follow the model proposed by Segall [1] , where the 
contents of the queues at the nodes are viewed as continuous 
quantities, rather than as integer number of messages (in Ch. 
VI we recognize the existence of separate messages but model 
their size as a continuous quantity) . This macroscopic point 
of view not only provides a model that is analytically simpler 
than others, but also is justified by recognizing that any 




C 




0, v(i,k) € Nq, t Q _< t <_ t 1 



(II. 4) 



k k 

tic environment is considered and a^(t) = a^, v(i,k) € N will 
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individual message (bit) contributes very little to the over- 
all behavior of the network. 

Let Q(tg) and Q(t^) be the system states at times t^ 
and t 1 respectively. We say that the state Q(t 1 ) is reachable 
from the state Q(tg) if there exists a feasible multicommodity 
flow schedule F(t) , t Q < t < t ± for which 

t ] _ 

q i (t l ) = q i (t 0 ) “ / r^(t)dt, * (i,k) e N Q (II. 5) 

or in shorthand notation, F(t) : Q(tg) -*• Q(t^) . To every feasi- 
ble multicommodity flow schedule we adjoin a delivery function 
D(t) , t Q <_ t <_ t^ which represents the total amount of data 
delivered to their destination by time t. 

D(t) = l [q?(t n ) _ q?(t) ] , t n < t < t, (II. 6a) 

(i,k)€N Q 1 U 1 o - _ i 

or equivalently 

D(t) = l / r^(a)da, t n < t < t, (II. 6b) 

( i / k) 6 N q t Q u - l 

From the nature of the model that we constructed and 

R T 

in particular from the fact that q^(t Q ) > 0 (i,k) e , we 

conclude that the zero state is reachable from any other finite 
state within some finite time t^ , i.e. there exist both t^ and 

'To avoid excessive notation complexity we will assume in 
the sequel that q^(tg) >0 ■*->■ (i,k) e Ng . The case of 

q^(t Q ) >0 ( i'J’lc ) e N q is included in the examples. 
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Fit), t 0 < t < t x such that F ( t) : Q (t Q ) - q^) = 0. Consequently, 
for every initial state there is some minimal value of t^. We 
define the minimal total delivery time t^ as 

0 . 

t-L = rain {t, F(t): Q(t n ) - Q(t,) = 0} (II. 7) 

1 { F ( t ) } 1 0 1- 

We conclude this section with a basic result regarding the 
nature of feasible multicommodity flow schedules. 

Theorem II. 1 ' 

Let Q(t Q ) and Q(t^) be any two states such that Q(t^) is 
reachable from Q ( tg ) . Then there exists a feasible multi- 
commodity constant flow schedule F^(t) = F, t Q <_ t <_ t^ such 
that F 1 (t) : Q(t Q ) - Q(t ] _) . 

□ 

This result implies that in order to transfer a system into a 
reachable state it is sufficient to look for an appropriate 
flow schedule within the subset of constant flow schedules. 

The benefits of this property will become evident in following 
chapters . 

3 . Piecewise Constant Flow Schedules 

From this point on we will narrow our interest to the 
subset of feasible multicommodity flow schedules which are 
piecewise constant. By an M-part constant-flow schedule 
F (t) , t Q <_ t < t 1 we mean 



See Appendix A for proof of this theorem. 
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f m {1) , t 2 < t < t x 



F M (t) = < F ^ (m) ' i < t < t 



■M 



m+1 



— m 



V F M (M) , t 0 < t < t M 



(II. 3) 



Consulting (II. 6) we immediately conclude that the correspond- 
ing delivery function D M (t) , t Q < t <_ t ± is piecewise linear. 
We write 



( 1 1 ) ~Pm ( i ) * ( t) , t 2 ^ t < t^ 



° M (t) = < -PmW * (t m "t) , t^ n < t < t 



M m M m ' m+1 — m 



V ^ t M~ t ^ — t - fc M 



(II. 9a) 



where p (m) is the total delivery rate in the m-th interval, 



P M (m) = l r^(m) (II. 9b) 

(i,k)eN Q 1 

The r^ (m) , (i,k) e Nq is the net delivery rate of the k-th 

commodity from node i (see (II. 2)) in the m-th interval, 
corresponding to the flow schedule segment F^(m) in- (II. 8) . 
Clearly, p (m) is the slope of the delivery function in that 
interval. An example of a piecewise linear delivery function 
is shown in Fig. II. 2 
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Fig. II. 2. Piecewise Linear Delivery Function 



4 . Example 

To fix ideas, in this subsection we provide a simple 
example of a communication network, and use it to illustrate 
the various notation and definitions introduced previously. 
Consider the network G(V,Lq) shown in Fig. II. 3. 




Fig. II. 3. Communication Network with Queued Data 
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For this netowrk 



V = {1,2,3} 

L 0 = ( [1,2] , [2,3] , [3,1] } 

N Q = { (1,2) , (1,3) , (2,1) , (2,3) , (3,1) , (3,2) } 
Q (0 ) = {0,10,5,0,0,5} 



Consider a constant flow schedule F^(t) , 0 <_ t £ 15 
given by its components: 



*2 1 f 3 2 

^ 12 3' 1 12 3' 



1 =1 f 3 2 1 1 

23 3' 23 3' 31 3' 



f 



2 
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1 

3 ' 



It is easy to check that F^(t) satisfies constraints ( II . 1 ) - ( II . 3) 
for all t, t e [0,15] and that F^(t) : Q(0) -*■ Q(15) = (). We 
find it useful to decompose the flow pattern into commodity 
chain flows as shown in Fig. II. 4. 




Fig. II. 4. Chain Flow Decomposition 
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Using (II. 2) we find the net delivery rates: 



r 



2 

1 



0, 




2 

3 ' 



r 



1 

2 



1 

3' 



= 0 , 



= 0 , 



r 



2 

3 



1 

3* 



4 

The total delivery rate is thus (their sum) p^(l) = -j and the 
resulting delivery function is given in Fig. II. 5. 




Fig. II. 5. Delivery Function 

B. OPTIMAL DELIVERY FUNCTION CONCEPT 

Recall that our objective is to find a flow schedule that 
will efficiently deliver a given set of data backlogs to their 
destinations. Thus, we need to establish what are the desired 
properties of an optimal delivery function and iind its 
generating flow schedule. In defining the optimality criteria 
we were led by the following goals: 



32 



(i) physically meaningful criterion; 

(ii) computational tractability of the solution procedure; 

(iii) gaining new insight into the problem. 

We will show that the criterion we have chosen actually attains 
these goals. In this section we discuss property (i) above. 
Properties (ii) and (iii) will be considered in the next 
chapters . 

1 . Convex Delivery Functions 

Consider some non-convex piecewise linear delivery 
function D^(t) . A typical example of such a function is shown 
in Fig. II. 6. 





Fig. II. 6. Non-Convex Delivery Function 

Let Q(t i ) and Q(t^) be the system states at times and ty 
respectively. Since Q(t^) is reachable from Q(t^) (by assump- 
tion) , then according to Thm. II. 1, it is possible to construct 
a constant flow schedule F^t), t ± < t < t^ such that 
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( t) : Q(t^) -*■ Q(tj) . To this flow schedule corresponds a 
linear delivery function, indicated by the broken line in 
Fig. II. 6. 

We define a new flow schedule F„ . (t) , t„ < t < t, 

M-l 0 — — 1 

as 



t A < t < t. and t. < t < t 

0 - - i ] 



ti < t < t . 

1 - J 

where F^(t) is the original flow schedule corresponding to 

4 - 

D^(t) . The new delivery function' ^(t) , tg < t < t-, is 

convex. It is not difficult to see that a similar procedure 
may be applied, repeatedly if necessary, to any non-convex flow 
schedule. We summarize this fact in Lemma II. 1. 

Lemma II.l 

Let D^(t), tg < t < be a non-convex piecewise linear de- 
livery function. Then there exists a convex piecewise linear 
delivery function ( t ) , tg £ t <_ t^ and K < M such that 
D R (t) >_D M (t), *t e [t Q ,t 1 ]. 

C 

There should be no doubt that in the context of our problem the 
delivery function D^(t) is preferable to D^(t). As a result 



( F M (t) ' 

F M-l (t) = 

( F 1 (t), 



By "delivery function" we mean, unless otherwise indicated, 
a feasible, convex, piecewise linear delivery function. Simi- 
larly, we use loosely "flow schedule" to mean a feasible, 
multicommodity piecewise constant flow schedule. 
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we conclude that the search for "optimal" delivery functions 
may be confined to the subset of convex delivery functions. 

2 . Preference Relation 

A 

Here we answer the following question: If Dt^(t) , 

t Q <_ t <_ t^ and D r (t) , tg <_ t^ <_ t^, are two delivery func- 
tions, which is preferable? From our previous discussion of 
piecewise linear delivery functions (see (II. 9)) we know that, 
for a given initial system state, a delivery function is 
completely specified by its corner points and delivery rates. 
We define T to be a descriptor vector for a delivery function 



T = 



( , p ^ , 1 2 



2 ' 






(II .10) 



Definition II. 2 

A 

Given two convex, piecewise linear delivery functions D (t) , 

t Q <_ t <_ t A and D B (t) , t Q < t < t B , we say that D A (t) dominates 

D B (t) iff T A < T B and T A = T B , i = 1 , 2 , . . . , j-1 for some j, 

K 3311 

j < min (M, K) , where T. denotes the j-th component of T. 

~ 0 n 



The implication of Def. II. 2 will become evident in the follow- 

A • B 

ing examples. In Fig. II. 7, D 3 (t) dominates D 2 since 
p A (l) < p B (D • In Fig. II. 8, D B (t) dominates D A (t) since 
t® <t A . In Fig. II. 9, D A (t) dominates D B (t) since t A < t B . 

3 . Optimality Criterion 

The definition of optimal flow schedule now follows 
directly from the preference relation that we established. 
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D(t) 




Fig. II. 7. Comparison of Delivery Functions 



D(t) 




Fig. II. 8. Comparison of Delivery Functions 
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D(t) 




Fig. II. 9. Comparison of Delivery Functions. 

Definition II. 3 

We say that a delivery function D^(t) , t Q £ t £ t^ is optimal 
for an initial system state Q(t^) iff 

T° = min {T. |tJ,T° . . ,T? ,}, j = 2 , . . . , 2M (II. 11) 

3 (D K (t)} 3 1 2 3~1 

C 

In words, D^(t) is an optimal delivery function if it is not 
dominated by any other delivery function. We shall call a flow 
schedule F^(t) , t^ <_ t <_ t^ which generates D^(t) an optimal 
flow schedule . 

There is a technical question concerning the existence 

of D?, (t) : Can we be sure that M, the number of corner points 

M 

is finite, because if not the delivery function will not be piecewise 
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linear. We defer the discussion of this point to Appendix E, 
since we need additional results before we can cope with it. 

Our definition of optimality is based on a particular 
preference relation, which we believe to be a natural one within 
the framework of the optimal delivery problem. Obviously, other 
preference relations (and thus optimality criteria) , based on 
the delivery function concept, can be designed. For example, 
the minimal total delay objective (see [1], [2]) may be speci- 

fied, in terms of a delivery function, as 



where Q(t^) = q , and the optimal delivery function is that one 
which satisfies (11.12). 



A legitimate question to be raised is: Since the optimal 



delivery function approach as well as the minimal total delay 
objective seem to have merits in the same workframe, are they 
related? To answer this question we need to introduce the con- 
cept of global optimality . 

Definition II. 4 

* * 

We say that a delivery function D M (t) , < t <_ is globally 

optimal iff 



{D ( t) } t 



min 



fc l 

/ t I 

0 (i'j)eN 0 ) 



q^(t Q ) - D ( t ) ]dt 



( 11 . 12 ) 




( 11 . 13 ) 



□ 
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Theorem II. 2 



Suppose there exists a globally optimal delivery function D (t). 

★ ★ 

Then D^Ct) and its generating flow schedule F (t) solve the 

optimal delivery as well as the minimal total delay problems. 

Proof : 

If we denote the total amount of data stored in the network 
at time tg by q Q then (11.12) may be written 

o t] - 

DJ, ( t) = arg (min [(t,-t n )q n - / D(t)dt]} (11.14) 

K { D ( t) } 1 ° ° t Q 

The graphic representation of (11.14) is shown in Fig. II. 10 




Fig. II. 10. Graphic Representation of Eq . (11.14). 
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The objective is to minimize the shaded area. Assume that 

D^(t) solves the problem and D^(t) ^ D^(t) . Then, since by 

definition D^(t) D^(t) , vt e [t^/t^] the double shaded area 

is smaller than the shaded area. This contradicts the assump- 
0 * 

tion that D^(t) r D^(t) and completes the proof with regard 
to the minimal total delay problem. 

Next, assume that D^(t) solves the optimal delivery 

j\ 

problem. Locking at D^(t) from t^ backwards, and arguing that 

by definition it satisfies (II. 11) , we find that it is identi- 
★ 

cal to D,^(t) . This completes the proof with regard to the 
optimal delivery problem. 

□ 

We conclude from Thm. II. 2 that if either criterion 
produces a globally optimal D(t) , then they are equivalent. 
Unfortunately, the conjecture that a globally optimal delivery 
function always exists for any multicommodity delivery problem 
is disproved by counterexample as shown in Appendix B. We 
shall prove later, however, that a globally optimal delivery 
function does always exist when all flows have a single 
destination . 

4 . Example 

We conclude this section with a simple example of opti- 
mal delivery function and its generating flow schedule. We 
use the same delivery problem as in Sec. A. 4 of this chapter. 

An optimal flow schedule is shown in Fig. II. 11, were 
we use the chain flow representation. 
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Fig. II. 11. Optimal Flow Schedule 

The optimal delivery function is plotted in Fig. 11.12. 
The broken line depicts the delivery function that we obtained 




Fig. 11.12. Optimal Delivery Function 
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for this problem in the previous section. A methodology for 
obtaining an optimal delivery function is treated in the next 
chapter . 
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III. SOLUTION ALGORITHM 



The definition of optimal delivery function (see Def. II. 3) 
suggests in itself a sequential structure of the solution al- 
gorithm. We start by solving for t!j* , the minimal time in which 
all the queues can be delivered to their destinations. Then, 
keeping t^ fixed we search for a flow schedule which generates 
a delivery function with a minimal possible delivery rate in 
its first interval. We denote this rate by p^. The next step 
is to hold t^ and fixed and search for t^ , the next corner 
point, etc. We will refer to the problems in which the mini- 
mal time (or corner location) are being found as Minimal Time 
Problems (MTP, for short). We will call the other problems, 
Minimal Rate Problems (or MRP) . Since there may be more than 
one corner point to consider, we will usually add an index to 
indicate which corner we are dealing with. We will show that 
both types of problems can be formulated as linear programming 
problems (LP) , and as such enjoy tremendous computational 
benefits. The mathematical properties of the optimal solutions 
as well as their meaning will be the subject of Ch. IV. 

A. THE FIRST CORNER POINT 

1 . The First Minimal Time Problem 

Let F^(t) be an optimal flow schedule and D^(t) its 
delivery function. Thm. II. 1 assures us of the existence of 
anF^(t), 0 < t < tj such that F^(t): Q(0) -► Q(t^) = 0 . The 
relation between D^(t) and D^(t) is pictured in Fig. III.l. 
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Fig. III.l. 



D°(t) 



versus D„,(t) 
M 



An important consequence of the above is that our search for 
t^ can be confined to the subset of constant flow schedules 
(with one corner only) {F.,(t)}. 

Definition III.l 

The First Minimal Time Problem is given by 
MTP (1) : min t^ 



s . t . 



t.{ y f k .(l) - l £ k ,(l)} = q k (0), *(i,k) s 

1 j(?i) v uh) 31 



N, 



j (^i) 



r K 

L f ij (1) 



k i) 



<_ c i j , v [i, j ] e L ( 



t v fjj(l) >0, v[i,j] « L q , *(i,k) £ N q (III. la) 
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The minimal value of the objective function of MTP(l) 
represents the minimal time by which the set of commodity 
queues Q(0) can be completely delivered to their destination 
by some constant flow schedule F^(t). We summarize this fact 
with the previous observation that we need to look only within 
the class of one corner flow schedules by 

Theorem III.l 

The minimal value of the objective function of MTP(l) 
equals t? . 

-L n 

L_! 

Problem (III. la) has some quadratic constraints. To 
overcome this difficulty we use a simple transformation of 
variables. Define 






- 



*(i,k) € N q , v-[i,j] € L 



0 



(III. 2) 



The transformation relies on the assumption that t^ > 0 . Ob 
viously this is the case in any problem of interest. Intro- 
ducing (III. 2) into (III. la) results in 



MTP (1) : 
s . t . 



min t. 



I u ij (1) 
(j^i) 3 



l u* (1) 
j(^i) : 



_t l C ii + ^ u i j (1) 

1 X3 k(^i) - 1 



V u ij (1) 



= q^ (0) , V (i,k) € N q 

£ 0, v[i,j] e Lq (III. lb) 

>_ 0, v[i,j] e L q , v(i,k) £ N q 



45 



which is an LP . The new variable (1) represents the total 
amount of data destined to node k that traverses link [i,j] 
during a period of length t^ 

2 . The First Minimal Rate Problem 

Now that we have found t^ we want to find a flow 
schedule which satisfies both t? and pj. 




Fig. III. 2. D^(t) versus D 0 (t) 

Let D®(t) be an optimal delivery function and let 
Q(t^-e) be the state of the system at some time t?-e , where 
0 < e < t^-t^. From Thm. II. 1 we know that there exists a con- 
stant flow schedule which can transfer the system from its 
initial state Q ( 0 ) to Q(t^-e). If we combine this flow schedule 
with part of the optimal flow schedule in the interval (t^-e,t^J, 
we obtain a two part flow schedule F 2 (t), 0 _< t £ t^. The 
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resulting delivery function D^(t) , 0 <_ t <_ t^ is shown in 
Fig. III. 2. We observe that the delivery function D 2 (t) has 
a delivery rate, in the interval (t?-s ,t^] , p 2 (l) which is 
identical to p^. 

Definition III. 2 

The First Minimal Rate Problem is given by 



MRP ( 1 ) : 



s . t , 



0 . k 



min £ 

( i , k) e N 



r i (1) 



0 



(t^-e)rj(2) + erv (1) = q£(0), *(i,k) e N ( 



l f jd! 

k(^i) 13 



£ c ^ , V [i, j] e L ( 



(III. 3) 



l fjj <2) 

k (r i) 3 



< c ± j, *[i,j] £ L Q 



r k .(l), r k .(2), f k .(l), f k -(2) > 0, *[i,j] £ L Q , *(i,k) £ N ( 
i] 1-3 1-3 



for any e such that 0 < e < 



where 



r k (p) = l f k ,(p) - l f^P)' £ N , 

1 j(£i) 13 j (ri) 31 



p = 1 /2 . 



0 



As in the case of MTP(l) also here we can state that 



Theorem III. 2 

The minimal value of the objective function of MRP(l) equals 

C 
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* 



The condition on e in (III. 3) requires knowledge of 
t 2 which has not yet been determined. This difficulty is only 
of a theoretical nature, however, since in practice we can 
choose s as small as we wish. If the very small e we picked 
is too large, i.e., e > t ^-t^ , then we will miss one corner 
point of the optimal delivery function and the solution we 
obtain will be suboptimal in this sense. On the other hand, 
there is not much to lose by overlooking corners in the optimal 
delivery function which are an infinitesimal distance apart. 

B. SUBSEQUENT CORNER POINTS 

By now it should be clear that the procedure of Section A 

in principle can be applied M-times in sequence to obtain the 

optimal delivery function. Thus, for example, the optimal 

delivery function solution to MTP (m) , which we denote by D^(t) 

m 

coincides with the optimal delivery function D^(t) in the first 
2m-l elements of the descriptor vectors (see (II. 10) and Def. 

II. 2). These elements are t^ , , . . . , / t^. The optimal 

delivery function solution to MRP (m) , which we denote by D m (t) 
coincides with the optimal delivery function D^(t) in 2m des- 
criptor elements, namely t® , , . . . , t^, p^. Since the term 
"optimal delivery function" may be confused with partial solu- 
tions we will usually use "optimal delivery function of order m" 
whenever we mean a solution to MTP (m) or MRP (m) for some m, 

1 <_ m < M. 

Using Fig. III. 3 and Fig. III. 4 to help identify the 
variables we can write linear programs for solving MTP (m) and 
MRP(m) as follows: 
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1 . The m-th Minimal Time Problem 
Definition III. 3 

The m-th Minimal Time Problem is given by 
MTP (m) : min t 

m 

s . t . 



I ( y 

p=l j (^i) 



u 




l 



j (*L) 



Uji<P>> 



q£(0) , v- ( i , Jc) £ N Q 



. ( p) - l u*. (P) >_ 0, v- ( i , k) eN n , p = l, 2 ,...,m 

j(*L) 13 j(*i) 3 ‘ 



-t c + l uj. (m) < 0 , *[i,j] s L 

m 13 k(£i) 3 



-t .c.. + 7 u^.Cm-l) < 0 , v [ i , j ] € L n (III. 4 ) 

m - 1 ^ k(£i) 13 ” ° 



l ^,(P) 1 At°c .[i,j] € L q , 

k(^i ) 13 * J 

p = 1 , 2 , . . . , m- 2 



_t p° + T ( l u?. (m-l)- l u . . (m-1) ) - 

~“ 1 m_1 (i,k) e N 0 j(?i) 13 j(*i> 31 



= 0 



nv 



I ( l u*(p)- l . u ji (P) ) = At pPp'P =1'2, 
i , ke N q j(*i) 13 j(^i) 3 P P 



t + t_ , 
m m-l 



= t 



m-l 



,m-2 
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U ij (p) ' t m' ^-1 - °' ¥(i ' k) e N q , v[i,j] £ L q , p = l,2,...,m 

, ^0 0 00 
for given Vl'Cl 1 

U 

We used the following change of variables: 



k , . 
u . . (p) 



and 



At°f k . (p) , 
P ID H 



t f . . (p) , 
p 13 ^ ' 



P = 1,2, . . 
p = m-l,m 



, m -2 

v (i,k) £ N Q , v [i , j ] £ Lq 

(III. 5) 



At 



0 

P 



A 




p 



1 , 2 , 



,m-2 . 



Fig. III. 3 shows the relations between the various parameters 
of MTP (m) . 




Fig. III. 3. The m-th Minimal Time Problem 
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Using Thm. II. 1 and the same reasoning as in Section A 



we see that 
Theorem III. 3 

The minimal value of the objective function of MTP(m) equals 
t°. 

m - 

u 

2 . The m-th Minimal Rate Problem 
Definition III. 4 

The m-th minimal rate problem is given by 



MRP (m) : 



min 

(i ,k) eN Q 



k , , 
r ± (m) 



s . t . 



(t^-e) r^ (m+1) +er^ (m) + 

mi i 




q£(0) , *(i,k) 6 N 0 




£ c.^ , v [i, j] e L q/ p = 1,2 



/ • • • / 



m+1 



(III .6) 




1,2 



r • • • / 



m-1 



r* (p) , f^j (p) > 0 , 



*(i,k) € N q , v[i,j] t L Q , p = 1 , 2 , . . . , m+ 1 



_ • ,0 0 
for given t^p^ 



• • • / 




where 
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and e is any real number such that 0 < e < t^ - 1^ . Fia 

m m+ 1 ' y ‘ 

III. 4 shows the relations between the various parameters of 
MRP (m) . 




Fig. III. 4. The m-th Minimal Rate Problem 

Again, using Thm. II. 1 to prove the existence of D^(t) 
as shown in Fig. III. 4 we conclude that 

Theorem III. 4 

The minimal value of the objective function of MRP (m) equals 

0 

P m . 
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C. SUMMARY OF THE SOLUTION PROCEDURE 

In Sections A and B we showed how to formulate the MTP (m) 
and MRP(m) in LP form. The solution algorithm consists of 
an iterative procedure in which we solve that pair of problems 
for each new corner point of the optimal delivery function. 

We refer to this kind of procedure as Sequential Linear Optimi- 
zation (SLO) . We will see in Chapters V, VI and VII that the 
SLO methodology is a very powerful tool for solving a variety 
of complex multicommodity network and certain other problems 
as well. 

1 . The Algorithm 

We now define conditions for algorithm termination. 
Suppose we have just solved the MTP(M), and thus found t^ . 

The optimal flow schedule of order M, D^(t) is actually the 
optimal flow schedule we are looking for. Suppose that we solve 
now the MRP to obtain p? 4 . It is obvious that the new flow 
schedule F M+ ]_ (t) will generate a delivery function E^_ (t) which 




Fig. III. 5. Stopping Rule 
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is identical to 



will coincide. 



D^(t) , and the points A and B in Fig. III. 5 
Thus the stopping rule can be written as 



p m (m) 



M 



stop 



(III .7) 



We can summarize the solution procedure "formally" in 
the following statement. 

Algorithm : 

m = 0 

Loop 

m +■ m+1 

solve MTP (m) and MRP (m) 

if p M (M) = p ® then stop 
M M 

Repeat 

r- 1 

u 

2 . Computational Complexity 

We now propose a conjecture which we believe to be 
correct although we have not been able to prove it rigorously. 

Conjecture III.l 

Let D^(t) be an optimal delivery function. Then the number 
of corner points M is bounded by | Nq | . 

M £ |N Q | (III. 9) 



where | Nq [ denotes cardinality of the set Nq . 



□ 



We briefly discuss this conjecture in Appendix F. 

We do not intend to comment further on the issue of 
computational complexity. There is a vast literature which 
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deals with efficient solutions of medium to large linear pro- 
grams, and much of it is dedicated to multicommodity struc- 
tures (see [3], [4]) . The objective of this thesis is to show 
how to apply these LP methods to the solution of certain dy- 
namic network problems. 

We conclude this chapter with a simple example of a 
computer solution to optimal delivery problem. An additional 
example is provided in Appendix G. 

3 . Computer-Solution Example 



q*(0) = 85, qj(0) = 30 




Fig. III. 6. Delivery Problem 

The delivery problem in Fig. III. 6 was solved using the algorithm 
presented in this chapter. As a result the optimal delivery 
function and its generating optimal flow schedule were found. 

The optimal delivery function is shown in Fig. III. 7. 



55 





The optimal flow schedule solution is shown in Figs . 
III. 7a to e. 





qj(0) =30 




Fig. III. 7a. Optimal Flow Schedule for t e [0,10] 
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I 




Fig. III. 7b. Optimal Flow Schedule for t e (10,15] 



qj(15) =15 




q^(15) =70 




Fig. III.7c. Optimal Flow Schedule for t c (15,20] 
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(20) =65 



I 




(20) = 30 



Fig. Ill . 7d . Optimal Flow Schedule for t e (20,50] 




Fig. III.7e. Optimal Flow Schedule for t e (50,57.5] 

It is somewhat surprising to find that even a simple 
delivery problem, such as the one considered here, should give 
rise to what might seem a complex optimal flow schedule. It 
is one of our aims in the following chapters, to show that what 
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appears to be a "random" looking optimal flow schedule has a 
lot of well defined structure to it. In particular, we shall 
return to discuss the above example at the end of Ch. V. 



59 



I 



IV. PROPERTIES OF THE OPTIMAL SOLUTION 



In Ch. Ill we have presented a sequential linear optimi- 
zation methodology for solving the optimal delivery problem. 

The availability of potent computational tools, like the sim- 
plex method (see [5]), makes the attractiveness of linear pro- 
gramming obvious . But it is not only the computational advan- 
tage that LP enjoys. For example, the linear dependence of 
optimal solution to changes, within certain bounds, in the 
right hand side (RHS) makes the LP formulation specially appeal- 
ing from the sensitivity analysis point of view. In this 
chapter, we use this and other known results of linear pro- 
gramming to determine some of the structural properties enclosed 
within a multicommodity delivery network problem. 

A. THE FIRST CORNER POINT 

1 . On the Minimum Time t^ 
a. The Primal Problem 

For convenience we restate the First Minimal Time 
Problem (see (III. lb)) in standard LP form. 

MTP (1) : min 



s . t . 




q^(0) , v(i,k) c N Q 




0, v[i,j] £ L 0 



(IV. 1) 




> 0 , ¥ [i, j ] £ L 0 , v(i,k) £ N 0 

□ 



60 



The slack variable s^(l) gives the amount of unused capacity 
of link [i , j ] over the period [0,t°], v[i,j] l q . 



Example : 




Fig. IV. 1. Three Node Network Delivery Problem 

The matrix formulation of (IV. 1) for the problem in Fig. IV. 1 
is given below. 

min t^ 

s . t . 



0 


0 


0 


0 


1 


0 


0 


0 


0 


-1 




q 




qj (°) 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 




= 12 (1 » 




q^to) 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 




s 23 (1 > 




q2 (0) 


0 


0 


0 


0 


0 


-1 


0 


1 


0 


0 




S 3 1 ( 1) 




q2 ( °) 


0 


0 


0 


0 


0 


0 


-1 


0 


1 


0 




u 12 (1 > 


= 


q3 (0) 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 




“12 (1) 




q3(0) 


-C 12 


1 


0 


0 


1 


1 


0 


0 


0 


0 




u 23 <!) 




0 


" c 23 


0 


1 


0 


0 


0 


1 


1 


0 


0 




•4<d 




0 


i — 1 

CO 

0 

1 


0 


0 


1 


0 


0 


0 


0 


1 


1 




“31 (1 » 




0 



(IV. 2) 



u 3i ll) : 
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X (1) ” (t l' s 12 (1) ' s 23 (1) ' s 31 (1) ' U 12 (1) ' U 1 3 ? (1) ' u 9^ (1) 



U 23 (1) ' u 3i (1) (1) ) > 0 



12 



*23 
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b. The Dual Problem 

The dual linear program to (IV. 1) can be written 
[6] as follows: 



DMTP (1) 



max 



l 

( i , k) s N 



k . .. . k ... 
o. (l)q. (0) 



0 



s . t , 



l ^ii (1)c i-i £ 1 

[i,j]cL n ^ ^ 



TT . . 

13 



£ 0 , v- [i , j ] £ L, 



(IV. 3) 



a i (1) _ °j (1) + ^jd) £ 0/ * (i,k) e N 0 , 



where 



and 



v-[i,j] e L q , 



□ 



k A n 
°k - 0 



Ad) (J (i) ,n (i) ) 



is a vector of dual variables. The vector £(1) has n(n-l) 
components corresponding to the n(n-l) conservation constraints 
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in (IV. 1) . Vector 11(1) has i, components corresponding to the 
i capacity constraints in (IV. 1). 

Applying the complementary slackness theorem of 
linear programming (see [6], p. 77) to (IV. 1) and (IV. 3) we 
have 

Lemma IV. 1 

Let X(l) and A(l) be optimal solutions for the primal and 



dual problems. 


respectively . 


Then v [i , j ; 


] e L q and v (i , k) 


€ N o 


(i) 


ujjd) > 0 




0^(1) - Oj(l) 






j (1) > CK(1) 


- C*<1) - 


u ij (1) - 0 




(ii) 


s ij (1) > 0 -+ 


"ij U) * 


0 


(IV 




IT . . (1) < 0 - 

XJ 


Sijli) = 


0 





where 

k , t . A . 
a k (l) = 0 

□ 

In Ch. II. A. 2 we concluded that in our network 
model, the zero state is reachable from any initial state of 
the system, provided that q^(0) > 0 -*• (i,k) e . This is 
equivalent to saying that problem (IV. 1) has a finite optimal 
solution. Using now the duality theorem of linear programming 
(see [6], p. 72) we conclude that the dual problem (IV. 3) has 
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also a finite optimal solution, and the corresponding values 
of the objective functions are equal. An immediate consequence 
of this argument is the following lemma. 

Lemma IV. 2 

Let t*? be the first minimal time. Then 



tj - I a k (l)q k <0) 

(i,k) € N 0 1 1 



(IV. 5) 



□ 



c. Stability 

In this paragraph we briefly discuss the question 
of uniqueness of the optimal dual solution and its relation 
to sensitivity analysis. 

Consider a linear program in standard (matrix) form 



LP: 

s . t . 



min z = T • X 



A X = b 



(IV. 6) 



X > 0 



D 



where F is the cost vector, A is the matrix of coefficients, 

b is the Right Hand Side (RHS) vector of requirements and X 

0 . 

is the vector of primal variables. And its dual: 



^The interpretation of these quantities in the Minimal Time 
Problem context can be deduced by comparing (IV. 6) to (IV. 2) . 
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DLP : 



max z = A -b 



s . t . 



AA < r 



where A is the vector of dual variables . 



(IV. 7) 



Definition IV. 1 

For a given requirement vector b, an LP is said to be stable 
or to be at a stable point if the optimal dual solution A is 
unique . 

Let the LP (IV. 6) be written 
LP: min z = + T D • X D 

s . t . 

BX 0 + DX n = b (IV. 8) 

B D 



X 



B 



/ 



> 



0 



□ 



where X is a vector of basic variables. We can transform 
B 

(IV. 8) into an equivalent linear program 



LP: 



min z = 



r B B ' lb + 



< r D - r B B ' lD)X D 



s . t . 



X D + B 1 DX„ = B 1 b 
B D 



(IV. 9) 



X 



B' X D ^ 2. 



□ 



If X D is a basic optimal solution (X n = 0_) it implies that: 
3 u 
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(i) ® ^ il 2.' i.e., it is primal feasible 

(ii) - j-, - . gB D >_ 0 , i.e., it is dual feasible 



(IV. 10) 



and 



A = r B B 



(IV. 11) 



is the related optimal dual solution to DLP . It should be noted 
that the primal feasibility does not depend on the cost vector 
T , and that the dual feasibility does not depend on the require- 
ment vector b . 

Let us now consider a new requirement vector b 

such that 



b = b - Ab (IV. 12) 



where 



Ab = el 



Ab 



Thus, e denotes the magnitude of the perturbation vector Ab 

A 

and 1 A , is a unit vector in its direction. In what follows 
Ab 

we will be concerned only with perturbations resulting in a 

A 

requirement vector b for which the LP has a feasible solution. 

We call such perturbations, feasible . If Ab is a feasible 
perturbation then, since the dual feasibility (IV.lO(ii)) does 
not depend on the requirement vector, the new solution to 
the perturbed problem will be optimal if it is primal feasible, i.e. 
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X B = B _1 (b -Ab) = X B -B X Ab >_ 0 



(IV. 13) 



An immediate consequence of condition (IV. 12) is 
that if X fi > 0, i.e. if the optimal primal solution is not 
degenerate , then there exists some real and positive such 
that condition (IV. 13) is satisfied for all feasible directions 

A 

l,^ an< ^ all 0 < e < On the other hand, if X B is degenerate 

it is always possible to find some direction of perturbation 
such that (IV. 13) is not satisfied unless the magnitude, e, 
of this perturbation is zero. 

Now, if primal feasibility is satisfied for the 
new (and therefore optimal) solution X B , then from (IV. 9) we 
have 



min z = r_B ^(b -Ab) = min z - T^B ^Ab (IV. 14) 

B ts 



The change 



Az = min z - min z 



(IV. 15) 



in the optimal value of the cost function is 



Az = r B B X Ab 



(IV. 16a) 



or in terms of the related optimal dual solution (IV. 11) 



Az = A*Ab 



(IV. 16b) 
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Definition IV. 2 



Consider an optimal primal solution to LP and let A be the 
related optimal dual solution. We say that a feasible pertur- 
bation Ab is acceptable if the change Az in the optimal value 
of the cost function due to that perturbation is 

Az = A-Ab 

□ 

It is clear from our discussion that if an optimal 
primal solution happens not to be degenerate then all feasible 
directions give rise to a nonzero acceptable perturbation. We 
now show that the same property holds for a weaker condition 
than primal solution non-degeneracy, namely stability. 

Let Ab be a feasible perturbation and assume that 
(IV. 13) is not satisfied unless e = 0. This also implies that 
X D is degenerate, i.e. there is at least one basic variable at 
zero level. If we force the magnitude of the perturbation to 
be somewhat larger than zero this causes one or more of the 
zero level basic variables to become negative. To satisfy 

A 

primal feasibility, a new optimal basis B has to be found by 
exchanging the basic negative variable (s) with appropriate 
non basic variable (s) . The optimal value of the cost function 
for the perturbed problem can be written as 

min z = PgB -1 (b -el Ab ) (IV. 17) 



This is usually performed by a Dual Simplex pivot step(s) 
(see [7] ) . 
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If we let e go to zero, then in the limit we have 



lim {min z} = min z (IV. 18) 

£->0 

from which we conclude that the optimal perturbed basis B 
is also an optimal basis for the original (unperturbed) LP . 

If we assume that the unperturbed optimal solution 
to LP was stable (unique optimal dual) , then we have 

r D B _1 = A (IV. 19) 

where A is the related optimal dual solution to the original 
DLP. As a consequence of (IV. 19) we state 

Theorem IV. 1 

At a stable point, there exists a real and positive £^ such 
that all the feasible perturbations Ab, where 

sb * e Vb 

and 

0 < £ < £^ 

are acceptable. 

G 

The application of Thm. IV. 1 to the optimal delivery problem, 
and in particular to MTP(l) results in 

Corollary IV. 1 

At a stable point, let t° be the first minimal time and let 
AQ = {Aq^} be a small change in the data queues sizes. Then 
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change At^ in the first minimal time which is caused by 
that perturbation of queues is 




I 

(i,k) eNg 



k , , > . k 
a ± (1) Aq ± 



(IV. 20) 



Necessary and sufficient condition for optimal 



dual solution being unique is not obvious but partial results 
exist. The next two results (see [5], p. 144) indicate condi- 
tions for the existence of optimal stable solutions. 

Result IV. 1 

If LP has at least one not degenerate optimal basic solution 
then the optimal dual solution is unique. 



Result IV. 2 

If LP has a degenerate optimal solution then the optimal 
dual solution is never unique if it is not degenerate. 



short as possible, we defer an illustration of stability in 
optimal delivery problems to Appendix D. For the rest of our 
study we will assume, without loss of generality, the existence 
of stability whenever we consider perturbation problems. This 
allows us to evaluate the effect of a perturbation on the opti- 
mal value of a cost function without considering the perturbed 
optimal basis, which is very convenient from the mathematical 
point of view. 

Our interest in the stability concept is strongly 
motivated by yet another property that we find very useful for 



□ 



To make the digression from our main exposition as 
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analysis purposes. Consider the LP in (IV. 6), and in particu- 
lar let 



^ = (Y,S) (IV. 21) 

where S is a vector of slack variables. We say that a con- 
straint is critical if its slack variable is zero in all 
optimal primal solutions. In the next section we show that 
if an optimal solution to LP is stable, then all the critical 
constraints can be uniquely identified with the help of the 
related optimal dual solution. It is again worth noting, how- 
ever, that there is no loss in generality associated with the 
stability assumption, since in Ch. V we present an algorithm 
to identify critical constraints even when the optimal primal 
solution is unstable. 

d. Critical Sets 

In [S] Ros showed that the optimal solution to the 
static flow routing problem imposes a certain partition of links 
and commodities into hierarchically related sets. Our study 
of the optimal delivery problem (= dynamic flow routing) re- 
veals the existence of a similar structure. We obtain a some- 
what more general result which involves critical sets of links 
and commodities as well as critical flow rates. In hindsight, 
the existence of a more general structure is not surprising 
in view of the higher complexity of dynamic versus static flow 
routing problems. Here we present results related to the criti- 
cal sets of links and commodities. The critical flow structure 
is considered in Section A. 2. Extension of these results to 
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subsequent corners of the optimal flow schedule will be 
studied in Section B. 

We start with definition of the critical set L^. 
Definition IV. 3 

At a stable point, a link [i,j] e L Q belongs to the set 
iff it. • (1) < 0. 

J □ 

The links in L 1 have the property that they must be saturated 

for the whole period [0,t®] in any flow schedule F (t) , 

-L 

0 £ t £ tfj| such that (t ) : Q(0) -> Q(t^) = 0_. To see that this 
is true we need to show that the links in are saturated in 
all optimal primal solutions to MTP(l) , and that no other links 
are saturated in at least one optimal solution. The first 
fact follows from ( IV .4 ( i± ) ) . Now suppose there is an optimal 
solution for which there is some link [i,j] e L Q such that 
s i ^ (1) = 0 and (1) = 0. Applying the theorem of strong 
complementary slackness (see [9], p. 54) to (IV. 1) and (IV. 3) 
we have 

Lemma IV. 3 

Given a pair of primal and dual programs with feasible solu- 
tions, there exists at least one pair of optimal solutions 
X (1) and A(l) for which: 

(i) uMl) > 0 •«-»• —it . . ( 1 ) = CKd) - CK(1) 

1 J 1 J -L J 

— it . • ( 1 ) > ck( 1) - a^(l) u^. (1) = 0 
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0 



(IV. 23) 



(ii) s ij (l) 



> 0 -H- tt . . (1) 

ID 



TT ^ j (1) < 0 S^ j (1) 



0 



where 




□ 



Since by the assumption of stability the optimal dual solution 
is unique, Lemma lV.3(ii) implies an existence of a different 
optimal primal solution for which the link [i,j] is not saturated 
any more. 



f erred to in Lemma IV. 3 are not necessarily basic solutions. 
Also, Lemma IV. 3 differs from Lemma IV. 1 in that the properties 
(i) and (ii) are implied here in both directions. 

To see that the links in L^ are not only saturated 
in all optimal primal solutions but in any flow schedule that 
empties all data queues by time tj , it suffices to refer to the 
proof technique of Thm. II. 1.' There it is shown how a flow 
schedule F^(t) , 0 £ t <_ t^ such that F^(t) : Q(0) -*■ Q(t^) = 0_ 
can be replaced by a constant flow schedule, F^(t) = F, 

0 <_ t <_ t^ such that F^(t) : Q(0) ■+■ Q(t^) = 0_. The construction 
used there assures us that a link [i,j] £ Lq is saturated in 
the constant flow schedule iff it is saturated in F^(t) for 
the whole period [0,t^]. This proves our point. 



In passing we note that the optimal solutions re- 



4 - 



See Appendix A. 
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Consider some commodity (i,k) e N Q , which uses 
links in the set . Let P(i,k) be a collection of all directed 
link chains connecting node i to node k. Suppose there is 
some chain p^ e P(i,k) such that p. n = 0, i.e. the set 
and the chain p^ have no links in common. In this case it 
would be possible to divert more of commodity (i,k) flow into 
this chain. Recall from Lemma IV. 3 that there exists at least 
one optimal primal solution for which all the links [i,j] / L^ 
are not saturated. This makes that flow diversion possible. 

But if a flow is diverted from the chains cutting through L^, 
some links in L^ will become unsaturated which contradicts 
the definition of the set L. . Thus, any commodity (i,k) which 
is using links of L^ enjoys the property 

p^ n L i ft 0, vpj € P(i,k) (IV. 24) 

If we denote by the set of all commodities that 
use links of the set L^ then (IV. 24) leads to the following 
theorem. 

Theorem IV. 2 

The set L^ is a disconnecting T set for commodities in N^. 

□ 

We say that a chain p^ e P(i,k) is active if the 
flow of commodity k is non-zero on each of its links. Let us 
pick for any commodity (i,k) which is using links of the set 

"^We follow here the terminology used by Ford & Fulkerson 
in [10] . 
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one of its active chains. From Lemma IV.l(i) we have 



L l' 

that for each link of that chain 



c (1) = 

a 



_7T a3 (1) + a 3 (1) ' ¥ t a '^ € 



(IV. 25) 



Using "chain substitution" we find that 



c^d) 



-tt. (1) + a (1) = 

la a 



-TT. (1) 
ia 



TT a3 (1) + Ojd) 



l . TT (1) 
[a , 3 ] a6 



(IV. 26) 



Since at a stable point. 



< 0, iff [a, 3] e L. 



\B a) 



= 0 , otherwise 



We conclude that commodities (i,k) e which use the set 
have their optimal dual variable o^(l) positive. We summarize 
this observation in a formal definition of the set N^. 



Definition IV. 4 

At a stable point, a commodity (i,k) 
N ] _ iff o^(l) > 0. 



e N q belongs to the set 

□ 



Again , 

that the set is 
F K (t) , 0 < t < t° 



as in the case of the set L^, it can be shown 
unique, i.e. the same for all flow schedules 
such that F K (t) : Q(0) -*■ Q(t^) = 0_. 
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Let us consider again the optimal delivery func- 
tion D^(t) and its generating optimal flow schedule F^(t). 

More precisely, let us look at the first part of F^(t), namely 
F^ll) , t^ < t <_ t®. The delivery rate in this interval p!j|, is 
the minimal delivery rate over all flow schedules F v (t), 

0 £ t <_ t^ such that F^(t) : Q(0) ->■ Q(t^) = 0_. From the results 
in this section we know that the critical set of links L-^ has 
to be saturated at all times t € [0,t^] and consequently for 
all t s (t^/t^]. The only commodities that can saturate L 1 
are those in the critical set . This being the case, we 
may expect that is the minimal value of flow rate with 
which the commodities in can saturate the link set . We 
address this proposition in the next subsection. 

2 . On the Minimal Rate p^ 

From the discussion of stability property in Paragraph 
(c) of the last subsection, we conclude that there exists a 

Jr 

real e, e > 0 such that all feasible perturbations AQ = {Aq^} 
that satisfy the equation 

l c k (l)Aq k = £ (IV. 27) 

(i,k)€N Q 1 1 

V 

where Aq i >_ 0 , *(i,k) e N Q are acceptable. This means that 
£ describes the change in the optimal value of the minimal 
time t^ which is caused by that perturbation. 

The plot in Fig. IV. 2 depicts the optimal delivery 
function D^(t) , 0 <_ t _< t^ (the solution to MTP(l)) and its 
perturbed version, say D^(t), 0 <_ t <_ t^ -e. 
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D(t) 



I 

(i,k) eN, 



0 




Fig. IV. 2. The First Perturbation Problem 



The perturbed flow schedule F^(t) , 0 <_ t <_ t^-e delivers all 
but Aq^, *(i,k) s Nq of each of the backlogged data queues 
q^(0) to its destination. 

Suppose we can find now another flow schedule F^(t), 
t^-e < t _< t^ such that F^(t) : AQ -*■ 0_. This flow schedule 
will generate a delivery function D 1 (t) , t^-e < t <_ tj which 
is shown by the broken line in Fig. IV. 2. The value of the 
delivery function D^(t) at time t^-e depends on the perturba- 
tion AQ that was chosen, and the locus of its possible values 
is shown by the vertical line in Fig. IV. 2. Our objective is 
to find a perturbation AQ , for which the value D^(t^-e) will 
attain its maximum. This obviously is equivalent to finding 
a delivery function D^(t) , t^-e < t <_ t^ with minimal value 
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of the delivery rate p ^ ( 1 ) . We can formalize now the above 
construction in the following Perturbation Problem: 



PP (1) : 
s.t, 



mm 



l 

(i,k) sN, 



Aq. 



I o^(l)AqJ = e 
(i / k) £ N 1 1 1 



a <£ - < l fjj - I fji>e 

1 j(*L) 1] j(*L) D 



= 0, *(i,k) € N, 



l i k . 

k) ^ ~ 



k(^i) 



c ij ' v ti/ j ] e L 



0 



(IV. 28a) 



Aq i' f ij - € n q' e l q 



where the positive value e is chosen small enough so that all 
AQ that satisfy (IV. 27) are acceptable. 

□ 

Due to stability assumption such an e exists and we 
can rewrite (IV. 28a) as 



PP(1) : 



s.t. 



V > 

mm i r. 



( i , k) eN 



0 



l °i (D^i = 1 

(ifkjet^ 



l f k . - l f k . - r k 

j(k) ^ j(k) 1 



= 0, v(i,k) € N n (IV. 28b) 
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L f ij ^ c ij' 4 



k(^i) 



'k Ik 



r i' f ij - °' ¥ (i' k ) e N q , v [i, j ] € l q , 



where 



A k 

-K 4 

r i e ' 



v(i,k) e N q 



C 



Moreover, for each acceptable perturbation and in 

particular for the optimal solution to PP(1) there exists a 

feasible flow schedule F^(t) , 0 <_ t <_ t^-e such that 

D?(t?-e) = \ (q^(O)-Aq^j. We stress this observation 

1 (i,k)eN 0 1 1 

here, since as a result we can state the next theorem. 



Theorem IV. 3 

At a stable point, the minimal value of the objective func- 
tion of PP(1) is equal to p^. 

G 

An immediate implication of Thm. IV. 3 is that the 
minimal flow rate can be found in a much simpler way than 
by solving MRP(l). The number of variables and constraints 
in PP(1) is considerably smaller (we are not concerned with 
flow variables corresponding to the period (0,t^-e]) than in 
MRP(l) . The only limitation is that the formulation of FP(1) 
is valid for stable points. 

A more important consequence of Thm. IV. 3 is that it 
enables us to obtain a new insight into the problem by a 
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careful study of (IV. 28b) . First, we want to indicate that 
problem (IV. 28b) is feasible. As an example we can pick any 
e, 0 < e < and a perturbation 

Aq i “ er^(l), v(i,k) e N Q/ (IV. 29) 

where r^(l) is the net delivery rate for the flow schedule 
F° (t) , v(i,k) 6 N q . Then 

f ij (1) = f ij (1)/ * k ' £ l q (IV. 30) 

is a solution to PP(1) . The corner point of the resulting de- 
livery function D^(t) is schematically indicated as point A 

J. 

in Fig. IV. 2. We say that the flow pattern of the optimal 
solution to MTP(l) is a feasible solution to PP(1). 

Another simple observation results from the structure 
of PP (1) . 

Lemma IV. 4 

In the optimal solution to PP(1) 

r k = 0 if a k (1) < 0 (IV. 31) 

□ 

This, together with the fact that a^(l) = 0, *(i,k) / N- sup- 
ports our previous observation that only commodities in 
play a role in the first segment of the optimal delivery function. 



By flow pattern we mean the flow composition, without any 
particular reference to time, e.g. an m-piece flow schedule is 
constructed of m flow patterns. 
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The perturbation equation 



v k . , . k . 

L c.(l)r. = 1 

(i ,k) eN 1 

has a very important interpretation: it expresses the condi- 

tion that the flows of commodities in need to satisfy in 
order to saturate the set . This interpretation can be de- 
duced by the following argument. The flow shcedule F^ (t) , 
t^-e < t <_ t^ whose flow pattern is obtained from the solution 
of PP(1) must saturate with commodities from , since it 
is a part of two segment flow schedule which delivers all the 
queues by t^ . Now, if we look carefully at the constraints 
of (IV. 28b) there is nothing there, beside the perturbation 
equation, that can account for this saturation property. 

Theorem IV. 4 

At a stable point, let £ (1) be the optimal dual solution to 
MPT ( 1 ) . Then a feasible flow pattern F, of commodities in 
saturates the set iff 

l °*<l>r* = 1. 

( i f k) e j-j 

The next topic we want to consider is the lower bound 
on p^. Suppose that we remove the feasibility constraints from 
(IV. 28b) and end up with 

"0 . r ~k 

p. = mm ) r. 

1 li.klcSj 1 

s . t . 
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1 



(IV. 32) 



r k , , . ~k 

l °i 1 r ± = 

(i,k)eN 1 

>_ 0, v- ( i , k) £ N 1 . 

□ 

It is obvious that £ p^, and thus can serve as a lower 
bound. It also is easy to see that for this simple LP 



'■'0 

Pi 



l/o 



max 



( 1 ) , 



(IV. 33) 



where 



a 

max 



( 1 ) 



max {a^ (1) } . 
(i,k) e N 1 1 



Theorem IV. 5 

At a stable point, the minimal rate p^ satisfies 



p, > 1/a (1) 

1 — max 



(IV. 34) 



where 



a (1) = max {a^(l)}. 

max (i,k)eN 1 



C 



A related result states 
Lemma IV. 5 

At a stable point, if the optimal delivery function of 
order one, D^(t) , 0 £ t _< t^ satisfies 
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0 *( 1 > 



°max ll) ' “ (i ' k) e N 0 



(IV. 35) 



then it is the optimal solution to the delivery problem. 

Proof : 

Suppose that condition (IV. 35) is satisfied. By Thm. IV. 4 
we must have that (in this case = N^) 

l ob)r(l) = 1 (IV. 36) 

( i , k) e N q 

Substituting (IV. 35) into (IV. 36) results in 



l 

(i,k) £ N. 



k n , 

r i (1) 



1/a (1) 

max 



(IV. 37) 



But the left hand side of (IV. 37) is equal, by definition, to 
the total flow rate p^(l). Comparing with (Iv.34) we must conclude 
that D^(t) is already the optimal delivery function and 
P L (1) = pj. 

□ 



An interesting case occurs when 



a*(l) 



a (1) , v (i,k) e 
max 



N n 



(IV. 38) 



and 



The delivery rate of the flow schedule solution to MTP(l), 
F^(t), may be viewed as composed of two constituents. 
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(IV. 39) 



P x ( 1) = P (N x ) + p (N Q -N x ) , 



where p (A) denotes the delivery rate due to commodities in the 
set A. Using Thm. IV. 4 and substituting (IV. 38) into the 
perturbation equation we obtain 



P(N 1 ) 



1/a 



max 



( 1 ) 



(IV. 40) 



Since all the backlogs are delivered by the time t^, we conclude 
that 



P(N Q -N 1 ) 



_L i 

tj (i,k) s N Q -N 1 



(IV. 41) 



We now show that in this particular case there exists 

a solution to PP(1) in which attains its lower bound, namely 

1/a (1) • Fig. IV. 3 will help the reader to follow the 

max ^ ^ 

argument . 




q*(0) 

1 



Fig. IV. 3. Special Case of the First Perturbation Problem 
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Let us take the flow schedule solution to MTP(l), 

F^(t) , 0 <_ t <_ t^ and increase the flows of all the commodi- 
ties in the set N 0 ~ N ]_ • This is possible since none of these 
commodities passes through L^, and thus all use only unsaturated 
links. As a result all the queues of commodities not in 
will be fully delivered prior to t^, say by some tine t^-e. 

Let us denote this new segment of a flow schedule by F^(t), 

0 <_ t <_ t^-£ as shown in Fig. IV. 3. In the remaining time 
interval (t^-e,t^], only the commodities in N-^ will continue 
to flow with a total rate p. (1) = 1/a (1) . This is denoted 

-L IT13.X 

~ 0 0 

by F-^(t) , t^-e < t _< t^ in Fig. IV. 3. Comparing this value 

of p^(l) with the lower bound on pj (IV. 34) makes our point. 

Two observations are appropriate here. First, in this 

particular case it is not necessary at all to solve the PP(1) 

since the minimal rate value is known to be p^ = 1/a (1) 

0 max 

ahead of time. Second, there is a slight change in the notion 
of the next time problem. In MTP(2) we will be looking ex- 
plicitly for the minimal time t^ by which all the queues of 
commodities not in can be fully delivered to their destina- 
tions, given that queues of commodities in N-^ are delivered by 
the time t^. These two observations have a considerable im- 
pact in the case of single destination networks where the 
special case we consider here turns out to be the general case. 

B. THE SECOND CORNER POINT 

We now begin a study parallel to that carried out in Section 
A, and define and describe the same type of concepts and 
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results that were derived for the first corner of the optimal 
delivery function. Since most results will be totally analo- 
gous we will not dwell on their proofs, unless the reasoning 
behind a proof is very much different from that in Section A. 

1 . On the Minimal Time t^ 



The Second Minimal Time Problem can be written (see 
Def. III. 3) in standard LP form as 

MTP (2) : min t 2 

s . t . 



I ( l uj (p) - l u*(p)) 

P=1 j (r i) 3 j (£i) 3 



= q* (0) , * (i,k) e N x 



I uj (2) - l u*(2) 

j C^i) 13 D 



j (ri) 



= q*(0) , *(i,k) / N x 



l uj . (p) - I j. (P) ' d^ (P) 

j(^i) 11 j C^i) 3 



0, * ( i , k) e N-^ , 

P = 1,2 



-t,c. . + l u*(l) 

1 3 k: (i,k) eN 1 13 



= 0, v[i,j] e (IV. 42) 



-t Ci . + l uj. (1) + s . (1) 

1 13 k: (i,k) e N 1 13 J 



■ t 2 C ii + l U ij (2! 

13 k: (i , k) 3 



0, * [i, j] / L-^ 



0, v [i, j] e L 1 



-t„c . . 

2 ij 



+ l 

k(*L) 



uj.(2) 



S ij (2: 



0 , * t i , j ] i 
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0 



-Vi 



I < 

( i , k) eN, j 



l 

&i) 



u . 



ij 



( 1 ) - 



l 

j (^ 1 ) 



u 






(1) ) = 



t l + t 2 



t 



0 

1 



d i (p) ' u ij (p) ' s i j ( 2 ) , t ± , t 2 > 0, v[i,j] £ l q 

v(i,k) e N n 



^ • .0 „ 0 
for given t^ and p^, 



In the formulation of (IV. 42) we have incorporated some of the 
results we derived earlier in this section. All the flows in 
the first time interval (t 2 /t^] are due to commodities in the 
set . This is so because any commodity (i,k) / ceases 
to flow (its queue is completely delivered) , in an optimal 
solution, prior to time t^. Also, there is no need for slack 
variables in capacity constraints for links in , since we 
know that they must be saturated for all t e [0,t^] . We note 
that the third constraint in (IV. 42) accounts for no intermedi- 
ate data storage (d^ (p) denotes the surplus variable for this 
constraint, * ( i,k) e , p = 1,2). In Fig. IV. 4 we indicate 
the basic relationship between the various parameters of 
(IV. 42) . 

Let A (2) = (I (2) ,«(1) ,8(2) ,11(1) ,11(2) ,a p (l) ,a fc (2) ) 
be the vector of dual variables for the dual problem to (IV. 42) . 
The vector 1(2) has |N q | components corresponding to the first 
two delivery constraints of (IV. 42) . The vectors Q(l) and 
0.(2), have |N 1 | components each and they correspond to the 
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0 



D (t) 



0 



t 



2 



Fig. IV. 4. The Second Minimal Time Problem 

"no intermediate storage" constraints for both epochs (p = 1,2 
in the third constraint of ( IV .42) ) . Vectors IT(1) and 11(2) 



represent the dual variables corresponding to the rate and the 
time constraints, respectively. 

Lemma IV. 6 (IV.1) T 

Let X(2) and A (2) be optimal solutions for the primal and 
dual problems, respectively. Then *[i,j] € L^ and v(i,k) e N Q 



have j L q | components each and correspond to the capacity con- 
straints in both time periods. Finally, a^d) and a t (2) 



(i) ujj(2) > 0 




a*(2) - a*( 2) 



-TT ij (2) > a*(2) - Oj (2) 




0 



We will indicate in the brackets the analgous result in 



Section A. 
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(ii) s i j (2) > 0 



(IV. 43) 



- Tr ij (2) = 0 if [i,j] / L x 
j_ j (2) < o -* S;Lj (2) = 0 if [i, j] / L 1 
j ( 2 ) ■'■ s unconstrained in sign if [i,j] £ L 1 



where 



o£(2) = 0 

□ 

Application of the duality theorm of linear programming results in 
Lemma IV. 7 (IV. 2) 

Let t^ be the second minimal time. Then 



l aj(2)qj() + a (2) t? 
( i , k) t N q 11 t 1 



(IV. 44) 



□ 



It is worth noting that t^ depends on the queue sizes and on 



* 



It is not difficult to see that at a stable point 
a t (2) < 0: Suppose that we resolve MTP(2) while we let 

t^ -*■ t^+At^. Now it is possible to deliver some small amount 
of each commodity in this additional interval and we expect 
t^ to decrease as a result by some At^ . Recalling that at a 
stable point, a t (2) relates the perturbation to the change in 
an objective function, we conclude that c t (2) <0. 

The discussion of stability in Section A.l.c applies 
without change to flTP(2) and we obtain: 
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Lemma IV . 8 (Corollary IV. 1) 



At a stable point let t^ be the second minimal time and let 
(AQ,At^) be a small change in the data backlogs sizes and in 
the minimal total delivery time t^ . The corresponding change 
in the second minimal time At^ is given by 



At? = l a^(2)Aq^ + a . (2) At? (IV. 45) 

(i,k)eN 0 1 i t I 

C 

Following the discussion in Section A.l.d we define 
the critical set L 2 . 

Definition IV. 5 (IV. 3) 

At a stable point, link [i,j] e Lq belongs to the set L 2 
either if [i,j] € 1^ or if [i,j] / and tt ^ ^ ( 2 ) < 0. 

□ 

The links in L ^ have the property that they are saturated for 
the whole period [0,^] in any flow schedule F K (t) , 0 £ t £ t^ 
such that 



(i) F R (t) : Q (0 ) -*■ J3f 

(ii) p K (l) = p°, *t € (t°,tj] 



(IV. 46) 



We note that the necessity to break the definition of 
L 2 into two exclusive cases results from the fact that (2) 
is in general not restricted in sign (see Lemma IV.o(ii)), 
for links [i,j] s L^. Thus, a simple statement like 
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[i/j] € 1*2 ^ j_ j ( 2 ) < 0, will not be correct. With the same 

precaution we define the set as follows. 

Definition IV. 6 (IV. 4) 

At a stable point, a commodity (i,k) e N g belongs to the 

set N 2 either if (i,k) € or if (i,k) / N 1 and a^(2) > 0. 

□ 

The commodities in N 2 have the property that they must 
flow through the set L 2 and saturate it during the interval 
[0,t 2 ] for all F^(t) such that (IV. 46) is satisfied. Using 
the same arguments as those leading to (IV. 24) we have 

Theorem IV. 6 (IV. 2) 

The set L 2 is a disconnecting set for commodities in L 0 . 

□ 

A false impression may result from our discussion, 
namely that each corner point in the optimal delivery function 
implies a new pair of critical sets. This is true only for 
the first corner point. It is possible that, for example, 

L 2 = and correspondingly N 2 = . This would be the case 

when the corner point occurs because the commodities in 
can not maintain the minimal flow rate any longer (backwards 
in time) . At this point a new rate p 2 will be computed without 
change in either or N^. This brings us into the discussion 
of p 2 . 

2 . On Minimal Rate p 2 

Our objective here is to study the properties of p 2 
and its interpretation. As before, we will rely on the stability 
assumption to simplify analysis. 
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D(t) 




Fig. IV. 5a. The Second Perturbation Problem 



Fig. IV. 5a depicts the optimal delivery function D^Ct), 

0 £ t <_ t^ (solution to MTP(2)) and its perturbed version 
_ 0 

D^tt), 0 _< t £ The perturbation equation derived in 

Section A (IV. 27) is not applicable here. We want to find a 
perturbation AQ such that D^t^-e) will be maximal but at the 
same time we must preserve previous results, i.e. the minimal 
rate and its duration t^-t^. The perturbed delivery function 
(t) in Fig. IV .5a has the required properties. It is described 
by a generalized perturbation equation 



l a*(2)Aq* + ea (2) 
( i , k) eN Q 



which may be also written as 



1 v k k , 

i-V 21 <i,k).N 0 ° i( )ri 



(IV. 47a) 



(IV. 47b) 
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As in PP(1), we require from the flow schedule F^t), 
t°-e < t < tj to satisfy F 1 (t) : AQ 0_. The broken line in 

Fig. IV. 4 denotes the delivery function (t) which is gener- 
ated by F^(t) . Now, if we permute the segments denoted by 
(b) and (a) , by permuting the corresponding flow schedules in 
time (this is always possible) , we obtain the desired struc- 
ture as shown in Fig. IV. 5b. 




Fig. IV. 5b. The Second Perturbation Problem (Permuted) 



_ 0 

Since maximizing D^t^-s) is equivalent to minimizing 
the delivery rate p-^(l) we can finally state the PP(2) . 
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PP (2) : 



min 



I 




i 



(i,k)£N 



0 



s . t . 




1 



(IV. 48) 




0, v(i,k) s N q 





>_ 0, * [i , j ] e L q/ * ( i , k) e N Q 



D 

By the stability assumption, all perturbations AQ 
that satisfy the perturbation equation (IV. 47b) are acceptable, 
and for each perturbation there exists a perturbed delivery 



can state the following. 

Theorem IV. 7 (IV. 3) 

At a stable point, the minimal value of the objective function 



□ 

The analysis of PP(2) leads to exactly the same results 
as for PP(1), aside from the slight modifications introduced 
by the factor l/l-a t (2) in the generalized perturbation equa- 
tion. We state those results here for completeness: 



function D^(t) of the form discussed. Due to this fact we 



for PP(2) is equal to p^* 
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From the structure of PP(1) we have 

Lemma IV. 9 (IV. 4) 

In the optimal solution to PP(2) 

= 0, if a^(2) < 0 (IV. 49) 

□ 

This, together with the fact that a^(2) = 0, v(i,k) / N 2 
supports our previous observation that only commodities in 
N 2 play a role in the second segment of the optimal delivery 
function. 

The interpretation of the generalized perturbation equa- 
tion is analogous to that in PP(1) . Observing that this is the 
only condition in the statement of PP(2) that can account for 
the fact that commodities in must saturate L 2 , we have 

Theorem IV. 9 (IV. 4) 

At a stable point, let £(2) be the optimal dual solution to 
MTP(2). Then a feasible flew pattern F, of commodities in N 2 , 
saturates the set L 2 iff 



l 



k , „ . k . 

a . (2) r . = 1 



^v 2 ’ (i,khn 2 1 



□ 



The lower bound on p 2 has basically the same form as 



the lower bound on p^. 
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Theorem IV. 10 (IV. 5) 



At a stable point, the minimal rate satisfies 



0 1 -°t (2) 

P 2 1 



a (2) 

max 



(IV. 50) 



where 



a (2) 
max 



max (o^(2)} 
(i,k)eN 2 



□ 



We can be certain that the flow schedule solution 
D 2 ( t ) , 0 £ t £ t^ generates the optimal delivery function if 
(of. Lemma IV. 5) 



o^(2) 



a 

max 



( 2 ) , 



^(i,k) e N 2 



(IV. 51) 



The special case that we discussed at the end of the 
last section applies here as well. As we indicated there we 
will discuss it in detail in the single destination networks 
case in Chapter V. 

C. SAMPLE PROBLEM 

From previous sections it is apparent how everything studied 
so far generalizes and applies to any corner point. From a 
conceptual point of view only two corner points have to be 
studied, since corner three, or any subsequent corner presents 
no significant difference with respect to the second corner 
point. We believe that it will be more enlightening to present 
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a detailed study of a sample problem than repeat the same 
ideas again. 

Example : 



qj(0) = 2q 

q^o) = q 

, v[i,j] € L q 

Fig. IV. 6. Sample Delivery Problem 

As the first step in solving the delivery problem in Fig. 

IV. 6 we wish to find the composition of the first critical set 
N . Obviously, can be only one of the following: 

(i) {(1,4)}, (ii) {(2,3)}, (iii) {(3,2)}, (iv) { (1,4) , (3,2) }, 

(v) { (3,2) , (2,3) }, (vi) { (1,4) , (2,3) }, (vii) { (1 , 4 ) (2 , 3 ) , ( 3 , 2 ) } . 

In what follows we consider explicitly each one of the above 
possibilities . 

(i) — For this case commodity (1,4) must have all its chains 
(here, there is only one) going through L^, which implies that 
at least one of the links [1,3], [3,2] or [2,4] must be in . 
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But this would imply that at least one of the commodities (2,3) 
or (3,2) uses links in and thus belongs to N 1 . This contra- 
dicts (i) . 

(ii) -- For this case commodity (2,3) must have both of its 
available chains going through L^, which implies that at least 
one link in each of the following pairs, { [2 , 1 ] , [1 , 3 ] } and 

{ [2 , 4 ] , [4 , 3 ] } must be in . It is not difficult to see that 
if link [2,1] is saturated so is [1,3]. Similarly, if link 

[4.3] is saturated so is [2,4]. This implies that commodity 

(1.4) uses links in L-^ and thus belongs to N^. This contra- 
dicts (ii) . 

(iii) — In principle the same type of argument applies 
here; we write in shortened notation: 



(iv) - In this case = {[3,2]}. Suppose that commodity 

(1,4) is using link [3,2] with some flow rate a, and conse- 
quently commodity (3,2) is using that link (remaining capacity) 
with flow rate 1-a . Then it is true (remember that at this 
stage we are solving for a constant flow schedule) that 



N 



1 



{ (3,2) } - [3,2] e L 1 



(1,4) e N x - N 1 1 { (3,2) } . 






a 



1-a 



or equivalently 




la 



q 



a 



1-a 
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We can eliminate the flow variable a by using the law of 
proportions, namely g. = g = g±g, such that 



t 0 _ 2q + q 

1 a + 1-a 



3q 



Now, we can also solve for a, to obtain a = 2/3. The remain- 
ing capacity on links [1,3] and [2,4] is thus 1/3 (actually, 
less than 1/3, say ^— £ , £ > 0, since commodity (2,3) / N-^ and 
in the solution to MTP(l) it must flow only through unsaturated 
links) . We find that the time required to deliver the queue 
of commodity (2,3) is 



ISL 



2(4 -£) 



6q 



■ 1 ' 



which contradcits our assumption in (iv) . 

(v) — We have already seen in (iii) that if commodity 
(3,2) e then also commodity (1,4) e N^, which contradicts 
(v) . 

Exercising our advantage over the reader in knowing the 
solution, let us study possibility (vii) prior to (vi) . 

(vii) — This case is equivalent to (iv) if we let e = 0 
(now commodity (2,3) e N^) in our discussion there. Then it 
must be true (for an optimal solution to MPP(l)) that 

qj(0) q^ ( 0 ) _ q^O) 

^1 ~ a ~ 1-a 2(l-a) 



or equivalently, 
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4 q 

2 (1-ct) 



t° = iSL = _2_ - 

1 a 1-a 

where the last equality can never be satisfied for non-zero a. 
We conclude that (vii) cannot be accepted as correct. 

(vi) — For this case = { [1 , 3 ] , [2 , 4 ] } (the remaining 
commodity (3,2) uses the unsaturated link [3,2] only, as 
required) . The chain flow decomposition of the constant flow 
schedule solution to MTP(l) is shown in Fig. IV. 7. 




Fig. IV. 7. Chain Flow Decomposition 



It must be true then that 



q? (0) 



a 



q^O) q^CO) 

2 (1-a) = T~ 



where 



3 < 1-a. 



(IV. 52) 
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If we consider in (IV. 52) only those elements that have the 
variable a associated with them, we have (using the law of 
proportions) 



2qJ(0) + q^ ( 0 ) 
2a + 2 - 2a 



qj (0) + j ( o ) 



(IV. 53) 



For the queues sizes we have selected, 



t = 4q 



(IV. 54) 



Using (IV. 52) and (IV. 54) we can evaluate a, 



a = ^ = 1 

4q 2' 



(IV. 55) 



and 8 



B = -3. = L 

P 4q 4' 



(IV. 56) 



which is less than 1-a = j ( as desired) . 

Now that we have established t^, and we turn to 
calculate p^, the minimal delivery rate in the first interval 
of the optimal delivery function. Recalling that (see (IV. 5)) 



l oj(l)q^(0), 
(i,k)eN 1 



and comparing to (IV. 53) results in 



oj(l) 



1 , a 2 ^ 2 ’ 



(IV. 57) 
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To obtain we have to solve PP(1) (IV. 28b), 

PP (1) : min £ 

(i,k)€N 1 1 

s . t . 

1 = l a*(l)r* (IV. 58) 

(i,k) £ N 1 1 1 

and 

{r^}, ^(i,k) e N-, is a feasible set of delivery rates. 

□ 

Consulting (IV. 57), problem (IV. 58) can be solved by 
inspection yielding 

(rj,r \) = (1,0), (IV. 59) 

which is shown in Fig. IV. 8. 




Fig. IV. 8. Solution to the First Minimal Time Problem 
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Thus, we conclude that 



0 



1 . 



The fact that the solution to PP(1) is unique, considerably 
simplifies the formulation of MTP(2) . Let Q(t 2 > denote the 



that there exists a constant flow schedule F(t), 0 £ t £ t 2 
such that F ( t) : Q(0) Q(t ? ) . This fact can be expressed by 

the chain flow decomposition in Fig. IV. 7 if we substitute 
Q(0)-Q(t 2 ) for Q(0). Also, we cannot be sure any more (nor is 
it required) that 6 < 1-a, since it is possible that N 2 = ^1 u (3,2) . 
Because of the uniqueness property of the optimal solution to 
PP(1) , we have that the components of 0^2^ are 



system state at time t 2 , 0 < t 2 £ t^. From our study we know 




(IV. 60) 



0 , 



otherwise . 



k k 

Since q i (t 2 ) < q^O), v(i,k) € N Q then in particular 




(tj " t 2 ) P 1 - (0) ' 



(IV. 61a) 



or equivalently 



t 




2q 



(IV. 61b) 



Equation (IV. 61b) presents a lower bound on the minimal value 



Let us check whether it is possible that t^ = 2q. This 
is equivalent to asking whether the queues of commodities (2,3) 
and (3,2) can be delivered within the time interval [0,2q]. 

Since commodity (2,3) and (3,2) have no common links in their 
respective chain flow decomposition we can assign a flow rate 
of 2 to commodity (2,3) and a flow rate of 1 to commodity (3,2) . 
It is easy to see that it will take = 2q and j- = q units 
of time to deliver the respective queues to their destinations. 

The complete optimal flow schedule is now shown in Fig. IV. 9. 




Fig. IV. 9. Optimal Flow Schedule 
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The optimal delivery function is shown in Fig. IV. 10. 




Fig. IV. 10. Optimal Delivery Function. 

□ 

A remaining problem, which, does not arise in the foregoing 
example, concerns the possibility of loops existing in the 
flow solution. Evidently, such loops cannot affect the opti- 
mality of the delivery function, but nonetheless their exis- 
tence is not aesthetically pleasing. Two comments are in 
order: First, such loops cannot appear if the input traffic 

between all pairs of nodes is non-zero. Second, given the 
time and rate parameters of the optimum delivery function, all 
loops can be eliminated by solving the last flow problem 
again, but this time with the objective of maximizing the sum 
of the link slack variables. 
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V. SINGLE DESTINATION NETWORKS 



By a Single Destination Network (SDN, for short) we mean 
that all the data traffic in a network is destined to a single 
node. Without loss of generality we will assume that node to 
be n, n s V. Accordingly, for present purposes we redefine 

Nq = set {i} of all nodes such that node i can communicate 



In general, we will simplify the notation by dropping out the 
destination indication, which is implicitly understood to be n. 

Naturally, all the results that were derived for multi- 
commodity case apply to SDN. Their generality though, tends 
to hide some of the unique properties of SDN which we study 
here . 

A. THE FIRST CORNER POINT 

The single destination variant of MTP(l) is given by 
MTP (1) : min t^ 



to node n, i r n 



s . t 





0, v[i,j] £ L q 



(V.l) 




v[i,j] £ L q 



n 
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where we have used the previously defined change of variables 



u . 
ID 



4 t. 



i] 



* [i# j 1 6 L 0 . 



The dual linear programming form to MTP(l) can be formu- 
lated exactly as in the multicommodity case. The same state- 
ment applies to the discussion of stability and to the defini- 
tions and properties of the sets and N^ . Let us assume, 
at this point, that the optimal solution to MTP(l) is stable. 
Hence, the sets and N^ are uniquely determined by MTP(l) . 
Later on in this chapter, when we discuss the solution algorithm 
for SDN, we will relax this assumption. 

By Thm. IV. 2, the set L^ is a disconnecting set for nodes 
in N^, i.e. every chain that connects any of the nodes i e N^ 
to the destination n has at least one of its links in the set 
L^. We shall see in the next few paragraphs that the maximal 

flow rate p (N, ) with which data can be delivered from the 
•max 1 

set N^ to the destination node n is given by the Max-flow 
Min-cut theorem (see [10], p. 11] 



P (N, ) 
max 1 



max J r . = CS (N n ) , 

{F> i£N x 1 1 



( V. 2 ) 



where CSCN^) is the value of a minimal cut-set, separating 

the set N„ from node n. 
x 

It is important to realize that in the SDN case the multi- 
commodity delivery problem turns into single commodity problem 

Discussion of the differences between single commodity 
and multicommodity can be found in [9]. 
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which makes the notion of minimal cut-set meaningful. To 
prove (V.2), consider an optimal flow solution to MTP(l). A 
typical source node i, i s is shown in Fig. V.l(a) . The 
initial queue q i { 0 ) is diminished with a rate r^l) (net 
delivery rate of data from node i) such that q^(t^) = 0. Part 
(b) in Fig. V.l describes an equivalent setup made up of a 
virtual node v connected to node i by an infinite capacity 
link [v,i] . There is a constant data input with rate r^(l) 
to node v. 

r = r^l) 




Fig. V.l. A Source Node in an Optimal Solution to MTP(l) 

If we extend the model to all nodes in the set N^, the result 
is as shown in Fig. V.2. 

Recall now that the critical set consists of all nodes 
i, i € Nq which determine the minimal time t^ . An implication 
of this characterization is that it is impossible to increase 
any of the initial queues (while not changing the others) 
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Fig. V. 2 . The Flow Pattern of pj(t) , 0 <_ t < tj 

without causing t^ to increase. Equivalently no delivery rate 
r^(l),i s can be increased, even momentarily, without 
decreasing some of the other delivery rates. 

To show that the flow pattern originating in node v and 
terminating in node n, as shown in Fig. V. 2, is maximal it 
suffices to demonstrate that there is no flow augmenting path 
(see [10], p. 12] from node v to node n. The existence of 
such a flow augmenting path would manifest itself in an allowa- 
ble increase of flow rate on exactly one of the links [v,i], 
for some i e . But this would be equivalent to an increase 
in exactly one delivery rate r^(l) , for some i £ (without 
changing any of the others) which is just what we have shown 
to be impossible. This brings us to the conclusion: 
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Theorem V.l 



Let F^(t), 0 <_ t <_ be an optimal flow schedule solution 
to MTP (1) . Then 

l r (1) = CS (N ) (V. 3) 

ie^ 1 - 1 - 

n 

As all the queues are reduced to zero by the time t^ we 
can write 



t 



0 

1 



l <3i<0) 

ieN 1 
CS (N x ) 



( V . 4 ) 



But it is also true that (see Lemma IV. 2) 

t? = l ct. (l)q. (0) ( V . 5 ) 

iel^ 1 

Comparison of (V.4) and (V.5) raises a question about the 
functional relation between the set of optimal dual variables 
and the value of the minimal cut-set CS(N^) . The next lemma 
answers this question. 

Lemma V.l 

At a stable point, let £ (1) be an optimal dual solution to 
MTP (1) . Then 



G i (l) = 1/CS (N x ) , vi e N ] _ 



( V . 6 ) 
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Proof : 



Suppose that not all a^(l) , i e are equal, and let a and 

b be a pair of sources in N 1 such that a (1) > a, (1). Define 

-L 3 . t) 

a new delivery problem for which 

q_ (0) -Aa, if i - a 

q b (0)+Ab, if i = b (V.7) 

q^(0) , otherwise 

and 

-o a (l)Aa + a b (l)Ab = 0 (V.8) 

where 




Ab > Aa > 0 



At a stable point, we can always find a perturbation (Aa,Ab) 
for which (V.8) is satisfied and the perturbation is acceptable. 

It is not difficult to see that condition (V.8) implies the 
fact (see Corollary IV. 1) that 



= t. 



( V. 9 ) 



~0 

where t^ is the first minimal time for the new problem. The 
total delivery rate of sources in is, for the new flow 
schedule , 
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(V. 10a) 



P (N^ 



l VO) 

ieN 1 



which can be also written as 



p (N 1 ) = p (N x ) + e 



(V.lOb) 



where 



e 



A 




Aa 



We already know that p (N, ) = p = (N, ) , and from (V.lOb) and 

nax ± 

the assumption that a (1) > cr, (1) we have that e > 0. Thus 

cl D 



P (N x ) 



P (N, ) 
max 1 



= CS (N^ 



(V.ll) 



which of course is impossible. This contradicts our initial 
assumption about an existence of unequal dual variables. As 
a consequence we may rewrite (V.5) as 



t 



0 

1 



a (1) 
max 



l <3i <0) 

ieN x 



and comparison to (V.4) completes the proof. 



( V. 12 ) 



It is interesting to observe in consequence that in SDN, 
the first minimal time t^ is always equally sensitive to changes 
in any of the queues in the set N^. 
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One of the significant properties of the set Lt is that it 
must be saturated by flows originating in the set , through- 
out the interval [0,t^]. The total rate of the saturating 
flows was found to be maximal and thus equal to CS(N^) . It 
is quite obvious that this flow rate cannot drop from its 
maximal value, even momentarily, since this would cause some 
of the data coming from sources in N-, to be delivered later 
than t^ . This observation holds for all flow schedules, as 
long as they terminate by time t? . We conclude that no seg- 
ment of an optimal delivery function may have a slope less than 
CS (N^ . 

Lemma V.2 

Let D^(t) , 0 < t < tj be an optimal delivery function in SDN. 
Then 

p° > CS(N.,), m = 1,2, ( V. 13 ) 

m — 1 

C 

We will show now that (V.13) is satisfied with the equality 
for the first segment of an optimal delivery function. Suppose 
that in the optimal solution to MTP(l) we find that = Nq . 

The total delivery rate of F^(t) , 0 £ t <_ t^ is maximal and 
equal to CS(N Q ) . It can be easily seen with the help of the 
sketch in Fig. V.3 that the existence of a delivery function 
(shown by the broken line) that dominates (t) would imply a 
delivery rate p'(N Q ) > CS(N Q ) which is of course impossible. 

We must conclude that D? (t) , 0 £ t £ t^ is the optimal delivery 
function. This proves our claim for the case of = N^. 
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D(t) 




Fig. V.3. Delivery Function with Maximal Flow Rate 

In general we may expect in a solution to MTP(l) that 
c n q . In this case it is possible to increase all the de- 
livery rates of sources in n q - n ^ since they use (by definition) 
only unsaturated links. Hence, all the data backlogged in these 
nodes will be completely delivered prior to time t^, say at 
some time t*j|-e . In the remaining interval only data from the 
set will continue to flow in the network, with the rate of 
CS(N^) . This simple construction proves the existence of a 
two part (e > 0) flow schedule with a delivery rate of CS(N^) 
in the interval (t^-e,t^]. 

Corollary V.2 

Let D^(t) be the optimal delivery function in SDN. Then 

pj = CS(N 1 ) (V. 14 ) 

□ 
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The proof leading to Corollary V.2 deserves some addi- 
tional discussion. Let us consider an optimization problem 
in which the objective is to minimize the total delivery time 
of data backlogged in N^-N^, while keeping the delivery time 
of data queued in at time t^. This is a slightly more 
formal statement of the construction method we used to prove 
Corollary V.2. Since the solution to this problem will auto- 
matically satisfy (V.14) we may use this new formulation as 
a substitute for our previous formulation, which required both 
MRP ( 1 ) and MTP(2) in order to obtain the value of t^. The 
substitute optimization problem can be written as follows. 



min t. 



s . t . 



I < l u ii(P) 

p=l j ( 7 * 1 ) 3 



l u ii ( P )) 

j (ri) Dl 



q i ( 0 ) , ^i € N 1 , p = 1,2 



u. . (p) - l u . (p) > 0, vi e N, , p = 1,2 

j(^i) ^ j(*i) D1 



l u -.( 1 ) - l u ji (i: 
j(^i) 13 j(^i) ' 



= qi (0) , vi e N q -N 1 ( V. 15 ) 



t 2 C ij + U ij U) 



1 t l C ij 



’ t 2 C i j + U ij (2: 



0, v [i, j] e L, 



u ij ( p), t 2 



0, v [i , j ] e L n , p= 1,2, 



□ 



115 



where we have used the notation 




¥ [i>j3 I» 0 



(ii) u i j (2) 



A 




The formulation (V.15) depends on the knowledge of the set 



we indicated before, we will later show that the stability 
requirement is not necessary. 

We now show not only that MRP(l) is not needed in SDN, but 
that the optimization problem in (V.15) can be formulated in 
a much more efficient way (with regard to the number of varia- 
bles and the number of constraints) . The basic idea is that 
the flow pattern of data delivered from the set in the 

period (t^-t^] can be ma< ^ e identical to its pattern in the 
0 n 

interval 1 0 , 1 2 ] • In other words, let p^ e P(i,n) be an active 
link chain used by some source i, i e with a rate r. [p^] , 
v-t s [ 0 , 1 2 3 - Then the same chain can be used to forward data 
from source i with the same rate r^ [p^] , vt € (t^t^]. In 

order to see it we need the following result. 

Theorem V.2 

There exists an optimal flow schedule F^(t) , 0 <_ t <_ t^ 
for which 



(and the time t^) , and hence on stability of MTP(l) . As 





(V. 16 ) 
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Proof : 



Before we start with the proof, we remind the reader that 
r^(t) is the net delivery rate of data from node i at time t 
( see ( II . 2 ) ) . 

Let i and j be any two nodes such that i e and j € Nq-N^. 
Let P(i,n) and P(j,n) be the sets of all directed chains con- 
necting node i and node j, respectively, to destination node 
n. Select any active chain p? e P(i,n) and let x be the head 

node of the first link in that chain that belongs to L^ (there 

x n 

is at least one such link since i e N, ) . Let p . c p . denote 

1 *1 *1 

the partial chain connecting node i to node x. Our claim is 
that 

if Pj is active then p* n p(? = 0, v-p^ e P(j,n). (V.17) 

This claim can be easily verified by referring to Fig. V.4. 





Fig. V.4. Illustration for Theorem V.2 
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Suppose that there is some active chain p^ s P(j,n) such 



that 



n n 
Pj n p. 



= [a , b] 



( V . 1 8 ) 



Since j / , the flow on this chain [p;/] , cannot go 
through , so that the chain must have the form (see Fig. 
V . 4 ) 



Pj ( j , . . . ,a,b, . . . ,c, . . . ,n) . ( V . 19 ) 

3ut this would imply the existence of a chain (not necessarily 
active) 



P ^ ( i , . . . , a,b , . . . , c , . . . ,n) , (V.20) 

which violates the fact that is a disconnecting set for all 
nodes in . We must conclude that (V.17) is true. 

Now, consider the optimal solution to MTP(l) and let p^ 
be an active chain in that solution, for some i £ N^ . Our 
proof of claipn (v.17) indicates that no data flow from any 
of the sources in Ng-N^ ma Y ever (in any flow schedule) use 
the partial chain p^ , and this is true for all partial chains 
of this type for all i e N^. In view of this observation we 
may require, without loss of generality, that an optimal flow 
schedule will have the same chain flow structure (p^,r^ [p^] , 
vi e N, ) as the flow solution to MTP(l). This in turn implies 
(V.16) since in MTP(l) the delivery rates of all the sources, 



118 



(V . 21) 



and in particular those in N^ , have the form 

V 0) 0 

r i (t) = — q , vi £ N Q , vt e [ 0 , t 1 ] . 

fc l 

This concludes our proof. 

□ 

Thm. V.2 does not mean that the solution to MTP(2) has 
no effect on the chain flow structure of sources in N^, but 
only that any effect must occur beyond the critical set . 

This is schematically indicated by point d in Fig. V.4. 

Suppose next that we have solved MTP(2) , so that the chain 
flows of sources in incorporate interactions with the chain 
flows originating in N Q -N^. Since in the period (t^/t^] only 
the sources in N^ are active we may require, without loss of 
generality, that their chain structure in that interval, will 
remain the same as in the interval [0,^]. This result leads 
us to a new formulation of MTP(2), which is described next. 

3. SUBSEQUENT CORNER POINTS 

Given N^ , t^ and armed with the results of the last section 
we can formulate the Second Minimal Time Problem as 



MPT ( 2 ) : 



min t. 



s . c . 



qi ( °) 

-t 2 “V“ + l 

t? j(*i) 



u . . 
il 



l -M 

j(*i) 3 



u . 



= o, 



VI 






I 

j (*i) 



u . . 

ij 



j 



I 

(^i) 



u . 



li 



qi (0) , vi € N Q -N 1 ( V . 22 ) 
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-t n c 



2 V_ . 

ID 




£ 0, v[i,j] € L q 




> 0, ^ [i , j ] € L q 



where we have used the transformation of variables 



A 





It should be noted that the number of variables as well as 
constraints is exactly the same here as in MTP(l) (cf. V.l). 

At a stable point, the optimal dual solution to MTP(2) may 
be used to identify the sets L 9 and N 2 (see Def. IV. 4) . More- 
over, using similar arguments to those used in the proof of 
Thm. V.l, an analogous result can be obtained for sources in 
N 2 • We state without proof : 

Theorem V. 3 (Thm. V.l) 

Let F 2 (t) , 0 £ t < tj be an optimal flow schedule solution 
to MTP ( 2 ) . Then 

(i) l r. (2) = CS(N-) 

icN 2 

(ii) l r . ( 1) = l r . (2) = CS (N ) 

i€N L isN 1 

I - ! 

Proposition (ii) above was already proved in Thm. V.2, but we 
include it here for completeness. 

Similarly, it can be shown (by analogy to Lemma V.l) 
that at a stable point, the optimal dual variables corresponding 
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to sources in N 0 -N^ are positive and equal, i.e. 



o i ( 2) 



a 

max 



( 2 ) , 



*i e N 2 -N 1 



( V . 2 3 ) 



The functional relation of a , (2) to the value of the minimal 

rricix 

cutset CS(N 2 ) can be determined as follows. Using Thm. V.3, 
we have 



t 



0 

2 



t°CS(N. ) + [ q. (0) 

i 6 N 2 -N i 

CS (n 2 ) 



(V. 24a) 



or equivalently 



t 



0 

2 



1 

CS(N 2 ) - csu^) 



i 

ieN 9 -N 1 



(V. 24b) 



But we also have (from Corollary IV. 1 and the form of RHS of 
( V . 2 2 ) ) that 



t,. = a 

2 max 



(2) _ l q i (0). 



ieN 2 -N 1 



Comparing (V.25) and (V.24b) we conclude that 



( V . 2 5 ) 



Lemma V . 3 

At a stable point, let £(2) be an optimal dual solution to 
MTP ( 2 ) . Then 



o i (2) 



1 

CS (N 2 ) -CS (N x ) ' 



*i e N 2 _n i 



(V. 26) 
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Next, using reasoning completely parallel to that in the 
proof of Lemma V.2 and its corollary we arrive at a similar 



result, which we state formally as: 



Lemma V . 4 

Let D^(t) k e an optimal delivery function in SDN. Then 



0 



cs(n 2 ) 



( V . 2 7 ) 



□ 



The implication of this result and its constructive proof 
is that we can proceed directly to solve a new version of 
MTP(3), without bothering to solve MRP(2). This new version 
of MTP ( 3 ) may be phrased as follows: — "Minimize the total 
delivery time of queues in the set n q -N 2 ' suc ^ that all queues 
in N 2 -N l are delivered by the time t^ and all queues in N^ 
are delivered by the time tj." In order to show that this 
MTP (3), like MTP(2), can be formally stated in an efficient 
way, we need to prove a result parallel to Thm. V.2. 

Theorem V.4 

There exists an optimal flow schedule F^(t) , 0 £ t £ t^ for 



which 



(i) r i (t) 





( 0 



( V. 2 8 ) 



otherwise 
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Proof : 



Proposition (i) is a restatement of Thm. V.2 and is included 
for completness. 

The proof is in essence identical to that of Thm. V.2. 




Fig. V.5. Illustration for Thm. V.4 

Our basic claim is that for all sources j, j e N 2 ~N^, any active 
subchain p^ remains free from any interaction with flows 
originating in the set n q - n 2 . Suppose that a flow coming from 
some node k, k s Nq-N 2 interferes with a flow coming from some 
node j, j e N 2 ~N-^ Since the flow from k cannot 

use the set L 2 (and in particular L 2 ~L^) by definition, it 
must use the bypassing chain which goes through node c. But 
this would imply that the node j has a chain outside the set 
L 2 which is impossible since L 2 is a disconnecting set for 
nodes in N 2 . This basically completes the major arguments of 

the proof. The remaining details are as in the proof of Thm. V.2. 

□ 
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By now the reader has no doubt surmised (correctly) that 
all the results derived up to here can be extended to subsequent 
corners of the optimal delivery function. We therefore conclude 
that the general character of the optimal delivery function 
is as illusted in Fig. V.6, where 




Fig. V.6. Optimal Delivery Function in Single Destination 
Networks 



m 



CIS (N ) , 

m 



m = 1 , 2 , . . . , M 



ITT .1 V 0 ’' m = 1 ' 



CS( V i.N 



m 



(V. 29a) 



CS (N )-fcs - (N T. 1 q^O), m = 2,3 M. 

lM V U m-1^ ieN -N . 

m m-1 
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and 



N„ = N . 
M o 



The general form of MTP (m) , m = is given by 



MTP (m): 
s . t , 



min t 



m 



q- (0) 

-t pr— + 2 U • • “ 1 U • ' 

m t? uh) 1] j<£i> ]1 

A. 



= 0 , *i 



/ N x , k = 1 



U- 



k- N k-r 
k = 2 , 3 , . . . , M 



1 u • • - y u . . 

j (^i) 13 j (^i) ^ 



* q i l0) ' ¥i « Wl 



-t c . . + u . . 
m 1 j 1 j 



= 0, *[i,j] e L m _ ] _ 7 (V . 29b) 



-t c . . + u . . + s . . 
m ij 13 



= 0, 6 L 0 -L m _ x 



t , u . . , s . . 
m' i]' xj 



>_ 0, v [i, j] e L q/ 

□ 



, 0 0 0 

where ^ ^ t 2 ' " ' ' ' t m-l are 9 lven ' an “ 



N 



M 



N 



[i, j ] 



There is no need for slack variables since the links 

s L , are saturated for all t € [0,t£], 

m-1 ™ 
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C . GLOBAL OPTIMALITY 

We stated previously that one of the distinctions between 
a multicommodity delivery problem and a delivery problem in 
SDN is exhibited in the fact that every optimal delivery 
function in SDN is also globally optimal. This is not true 
for multicommodity case, as the counter example in Appendix 
B indicates. 

Theorem V.5 

Let D^(t) be an optimal delivery function in SDN. Then it 
is also globally optimal. 

Proof : 

Assume to the contrary that there exists some other delivery 
function D (t) , 0 < t < t *? for which 

A — — X 

D ( t ' ) > D^(t'), for some t' € [0,t?]. (V.30) 

A M X 

With the help of the optimal delivery function let us find m, 

m € {1,2,..., M} such that t' € (t^ + ^ , t^] . Let US mar ^ now 

all the data stored in nodes of the set N n -N so it will be 

0 m 

distinguishable from the data stored in the nodes of the set 

~ 0 

N m « Before applying the flow schedule F^Ct), 0 <_ t <_ t- which 

v\ 

generates the delivery function D (t) , let us place an observer 

A 

at node n. His duty is to count how much marked Q m and unmarked 
Q u data is delivered to node n, up to time t'. 

°K (t '> = Q m + Q u (V ‘ 31 > 
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It is clear that 



Q m 

m — 



l q ± co) . 

ie N -N 
o m 



( V. 32) 



The observer cannot count more marked data than there was 
initially in the network. Also, 



Q < CS (N ) -t ' (V. 33) 

u — m 

since no more than CS (N ) of unmarked data per unit time can 

m 

reach the node n at any given time. Thus 

A 

D ( t ' ) < l q. (0) + CS (N ) ■ t 1 . ( V. 34 ) 

K “ isN n -N 1 m 

0 m 

But the right hand side of (V.34) is exactly the value of D ^ ( t ) 

at time t', which contradicts (V. 30) and completes the proof. 

□ 

The proof of Thm. V.5 is not dependent anywhere on the fact 

that the flow schedule F (t) is feasible in the narrow sense 

K 

(see Appendix A), i.e. does not allow for intermediate storage 
of data in the network. Combining this observation with the 
result of Thm. II. 2 We know that the optimal delivery function 
and its generating flow schedule also solve the minimal total 
delay problem over the class of flow schedules that allow 
intermediate data storage. As such, we obtain a much simpler 
solution algorithm to that problem than the one described in [11] . 

4 - 

' The work of Shats and Segall seems to be the only known 
open loop solution to the minimal total delay problem in SDN. 
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D. SOLUTION ALGORITHM FOR SINGLE DESTINATION NETWORKS 

Up to now we have established that the optimal delivery 
function and its generating flow schedule can be obtained by 
solving a sequence of specialized MTP ' s . In addition, the 
size of each of the problems is limited to 21+1 variables and 
n+Jl-1 constraints independently of which corner point we are 
solving for. The only condition that we assumed, for the above 
to be true, is that a solution to MTP(m), m = 1,2,...,M iden- 
tifies uniquely the critical set N , or equivalently, is stable. 
When we say the set N^, we really have in mind the nodes in 

N -N , since the nodes in N . were supposedly identified at 
m m-1 m-1 ^ 

previous corners. 

Consider an optimal dual solution £ (1) for MTP(l). Define 
N^ = set {i} of all nodes i e Nq such that ck (1) > 0, 



and 




set {[i,j]} of all links [i,j] € L^ such that tt^ < 0. 



A useful interpretation of the sets N^ and L^ can be obtained 
with the help of the following lemma. 



Lemma V.4 



Let £ ( 1 ) be an optimal dual solution to MTP(l). Then 



a.(l) >0 -»■ i e N, 

l 1 



(V. 35) 
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Proof : 



Let i, i e Nq be some node for which a^(l) > 0. From (IV. 10) 

we have (for SDN, k = n) 



°i (1: 



, l „ W 1 ’- 

[a ,g ] 



(V.36) 



where is any active chain connecting source i to the destina- 
tion n. Since ir^ <_ 0, v[a,6] e Lq we conclude that there exists 

at least one link in the chain p n , for which it _ < 0 . From the 

aB 

slackness theorem (see Lemma IV.l(ii)) we know that this particu- 
lar link will be saturated (zero slack variable) in all optimal 
primal solutions, and hence belongs to the critical set L n . Any 
source node using this link must belong to the set . We con- 
clude that i £ N 1 . 

□ 

It is clear now that the set consists of all the members 
of that were uniquely identified by the optimal solution to 
MTP ( 1 ) . 



N 



1 

1 




(V. 37) 



and similarly 



L 



1 

1 



c 



L 



1 



where the equality holds if the solution to MTP(l) is stable. 

It should be observed also that the set N~ cannot be empty. This 
can be easily deduced from application of (IV. 5) to MTP(l) : 
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(V. 38) 



tj = l (1) q ± (0) 

ieNQ 

Since > 0 and q^(0) >_ 0 , *i e Nq there must be at least one 

node i, i e Nq for which a^(l) > 0. This also implies that 

there is at least one link (a, 6] e L A such that it -(1) <0. 

u ap 

Up to this point we have no way of identifying the remain- 
ing members of . But let us try to proceed with the solution 
algorithm in spite of this fact. We will use the set in- 
stead of N^; as a result we obtain a slightly different formu- 
lation for MTP ( 2 ) . 



MTP ( 2 ) 



min t. 



s . t . 



qyo) 

-t, - + > u. . 

2 t° nk) ^ 



y u . . = 0 , v-i e N) 

L 31 



j (^i) 



u . 



j (*i) 



13 



u . . 

j(Pi) 



= q i (0 ) , ( V . 39 ) 



-t A c . . + u . . 
2 13 13 



0 , * [i, j ] e L- 



■t~c • ■ + u . • + s . . 
2 13 13 13 



= 0, *[i,j] { L 



s • ■ , t A , u . . 
13 2' 13 



> 0 , v [i, j ] £ L, 



□ 



In this equation we don't need slack variables since we 
know that all the links in L., have always to be saturated. 
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Suppose now that actually c . Then it is impossible 
to deliver all the queues in the set prior to time t® 

while keeping at the same time the delivery rates of all the 
nodes in N 1 at the value q i (0)/t°. We therefore conclude that 

Lemma V.5 

Let t^ be the optimal value of the cost function for problem 
(V. 39) . Then 



c U 1 -> t° = tj (V. 40) 

□ 

This does not necessarily seem like progress until we con- 
sider the optimal dual solution to (V.39). Using again (V.5) 
for our problem here, we obtain 

= tj = l C i (2)q i (0) (V. 41) 

1/hJ 

which implies (similarly to (V.38)) that there must be at least 
one node i, i / such that a^(2) >0. We want to show now 
that this node belongs to N^. Let us pick some active chain 
for that node. If the chain passes through L^ , we are done, 
since this implies that i s . If the chain does not go through 
L^ , then we can repeat the argument used to prove Lemma V.4. 

Defining 

N 1 = N 1 u > 0 and 1 £ (V. 42) 



and 
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u { [i , j ] 



( V . 4 3 ) 



L 



2 

1 



j < 0 and [ i , j 3 / Lp 



2 2 

we can solve (V.39) again, this time using and L-, instead 
of and L^, respectively. In view of the precedding dis- 
cussion we are assured that after a number of iterations k^ , 
kf £ |NjJ the whole set (and L^) will be identified and we 
may proceed to solve the original MTP(3). 

The general idea behind the solution procedure and how it 
applies to subsequent corner points should now be clear. The 
only consequence of instability in any of the corner points 
is to increase the number of iterations needed to reach the 
next corner. If we let K denote the total number of iterations, 
where 



M 

K = J k. (IV. 44) 

i-1 1 



then we obviously have 



M £ K £ |n q | (V. 45) 

where M is the number of corners in the optimal delivery 
function in SDN. 

E. REMARK ON MULTICOMMODITY FLOW SCHEDULES 

In this subsection we briefly discuss a class of multi- 
commodity problems for which the optimal dual variables satisfy , 
at every corner, the following relation: 



132 



k, \ 
a i (m) 



a (m) , (i ,k) e 
max 



N 



m 



m = 1,2, 



(V. 46) 



In particular, it can be shown that the data flow rate with 

respect to the set N is maximal in the period [0,t°], i.e. 

m ^ m 



y 

:i,k)sN. 



rj(t) 



P__ „ (N ) , *t € [0,t ] 

max m m 



m 



(V. 47) 



The delivery of all data queues corresponding to the set 

Nq-N^ can be accomplished prior to t^, say by t^-e, since by 

definition the flows of commodities in N -N only use unsaturated 

0 m J 

4 * 

links. Thus the generalized perturbation equation must be 

satisfied by flows of commodities in the set N (see Thm. IV. 9) 

m 



c (m) 
max 

1 - (m) 



1 

:i,k) € N 



r^(t) = 1, *t £ (t°-e,t°] ( V . 4 8 ) 

1 mm 



m 



Using (V.47) in (V.48) we have 



1 - c fc (m) 
Pmax(Nn,) = °max (m) 



( V . 4 9 ) 



As a consequence, the optimal delivery function for this class 
of multicommodity problems is characterized by: 



(i) 



m 



max m 




a 

max 



(m) 

ImJ 



(V. 50) 



A more detailed argument can be found in Chapter IV. A. 2. 
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m = 2, 3, . . . ,M 




and 



1 

(i,k) €N 1 





p 

max 




Moreover, it is easy to see that the proof of global opti- 
mality for SDN applies without change to the mul ticommodity 

case considered here if we use p (N ) instead of CS (N ) , 

max m m' 

since the two are not equal in general for the multicommodity 
case . 

It turns out that computer solution example which we con- 
sidered in Chapter III. 3 falls into this category of "SDN 
like" multicommodity problems, i.e. multicommodity problems 
for which the "optimal" solution is also globally optimal. 

For convenience we restate that delivery problem. 



q^(0) = 85, qj(0) = 30 



q^O) = 15, 

q^ (0) = 20 




q^O) = 10, 

q^O) = 50 




Fig. V.7. Delivery Problem of Chapter III.C.3. 
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The critical sets for this problem are (from the computer 
solution) : 

N ] _ = { (1,2) , (1,3) } , N 2 = {(2,3)} u N ] _, 

N 3 = {(3,2)} u N 2 , N 4 = {(3,1)} u N 3 , ( V. 51) 

and N 5 = { ( 2,1) } u N 4 . 

It is not difficult to see from Fig. V.7 that the maximal 
flow rates with respect to the critical sets are: 



° m ax (N l> * 2 ' %ax (N 2> = 3 ' s max (N 3> * 4 ' 



p m , v (N.) = 5, and p (N c ) = 6. 
max 4 'max 5 



Using (V.50) we obtain the optimal corner times 



(V. 52a) 



.0 _ 115 _ c-7 c ^0 _ 50 _ 

t 1 2 57.5, t 2 3 _ 2 oO 



0 _ 20 
3 4-3 



= 20 , 



0 15 



t„ = 



5-4 



= 15 



(V. 52b) 



and 



. 0 _10_ 
5 6-5 



= 10 



Comparison with Fig. III. 7 will immediately reveal that (V.52) 
is a correct description of the optimal delivery function. 

This completes our promise at the end of Chapter III, to 
show that what looks like a random flow schedule has indeed a 
lot of structure, and thus simplicity, to it. 
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F. SAMPLE PROBLEM 

We conclude this chapter on single destination networks 
with a short study of a sample delivery problem. This gives 
us an opportunity to illustrate some of the special proper- 
ties that are characteristic of SDN. 

In [11] ' Shats and Segall presented an interesting algorithm 
for solving minimal total delay problems in SDN. We have shown 
(see Thm. V.5) that the optimal delivery function is also 
globally optimal in SDN and thus (cf. Thm. II. 2) serves as an 
optimal solution to the minimal total delay problem. Unlike 
in [11] , the sizes of linear programs that are required in our 
solution procedure are independent of the number of corners of 
the optimal delivery function. This makes our algorithm ade- 
quate to solve large network problems, a task which could not 
be handled by the authors there. We believe that there is also 
another advantage to our methodology, namely the additional in- 
sight it provides. 

We have adopted one of the computer solution examples from 
[11, p. 73] as our sample problem. We intend to show that by 
using concepts introduced here it can be solved, with very little 
effort, actually by inspection only. 

As the first step in solving the delivery problem in Fig. 

V.8, we wish to find the composition of the first critical set 
N^ . Obviously, N^ can be only one of the following: 



'The study in this reference aroused our interest in SDN, 
and inspired many of the results obtained in this chapter . 
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Fig. V.8. Single Destination Delivery Problem 

(i) {1}, (ii) {2}, (iii) {3}, (iv) {1,2}, 

(v) {2,3}, (vi) {1,3}, (vii) {1,2,3}. 

Let us now consider all the possibilities for which node 
1 e (i.e. : (i) , (iv) , (vi) and (vii) ) . As a result of our 

study we know that the chain flows originating in N, must satur- 
ate CS(N^) in the optimal solution for all t e [0,t?]. An 
immediate consequence of this statement is that node 2 has no 
available chains, during that period, to send its data to the 
destination n. This leaves us with possibilities (ii), (iii) 
and (v) . By using exactly the same reasoning we can discard 
possiblity (iii). 
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Now, suppose that = {2,3}. Since the flow originating 
in must saturate CS (N^) , one of the following chain flow 
decompositions must be part of the optimal flow schedule: 




or 





Fig . 



Then, it 
(a) 



V.Sb. Alternate Chain Flow 



also must be true that 

° _ J5_ = 4 

1 1+a 4-a 



Decomposition for 



{2,3 



or 
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4 

3+e 



For the first case we have a solution for a, a 



1 and for 



the second case, S = -15. Both of course are infeasible and 
we conclude that = {2}. 

We are ready to construct the optimal flow schedule. The 
flows from node 2 must saturate CS(2), which is equal to 2. 

The chain flow decomposition which achieves this is unique and 
is shown in Fig. V.9. 



Fig. V.9. Optimal Flow Schedule for Source (2). 

We are left essentially with a delivery problem shown in 
Fig. V.10. 

The final solution should be obvious to the eye at this 
point. For completeness though, we continue with our formal 
exposition . 

Suppose now that 



] 




— CS (2) 2,5 



{1,3} e N 2 - N l 
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1 



q 1 (0) =2 




q 3 (0) =4 



available capacities are 
indicated on links 



Fig. V.10. Delivery Problem for Sources in N^-N^ 



this would imply the chain flow decomposition which is shown 
in Fig. V.ll. 




Fig. V.ll. Chain Flow Decomposition for = {1,3} 



Also , 



° _ _2_ _ 4 

^2 2+cx 3-a 
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This leads to a = - 1/5, which is unacceptable. The only- 
remaining possibility is shown in Fig. V.12. 




Fig. V.12. Optimal Flow Schedule for Sources (1) and (3) 



The solution presented in Fig. V.12 is equivalent to the 
following statements: 



(i) N 2 = {3} u N x 

(ii) N 3 = {1} u N 2 



where 

N x = {1} 



The resulting optimal delivery function is shown in Fig. 
V. 13, where 



P ± = CS ( 2) = 2, 



p 2 = CS (2,3) 



P 3 = CS ( 2 , 3 , 1) = 7 



5 
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U)| K> 



D(t) 




Fig. V . 13 . Optimal Delivery Function 



and 



t 



0 

1 



q 2 (0) 

CS (2) 



2 



1 

2 



t 



0 

2 



q 3 (0) 

CS ( 2 , 3 ) -CS ( 2 ) 




,o q i (0) 

t 3 ~ CS (2 , 3 , 1) -CS (2 , 3) 



□ 
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VI. APPLICATION TO STOCHASTIC DELIVERY PROBLEMS 



We have studied in depth so far the optimal delivery prob- 
lem. The mode that we have used in our discussion is based on 
the assumption that during the period of interest the data 
input rate is identically zero. We find it convenient, espec- 
ially in view of the forthcoming discussion, to refer to that 
class of delivery problems as "deterministic." 

We now focus on stochastic delivery problems. Here the 
data input rates are assumed to be governed by some stochastic 
process. In this new framework, the time necessary to empty 
a data queue (deliver its contents to their destinations) is 
no longer a deterministic value but a random variable. In [12] 
Yee suggested use of the expected delivery time as a performance 
measure for dynamic routing. We demonstrate that the Sequential 
Linear Optimization (SLO) methodology, which we used to solve 
the deterministic case, can be applied to the stochastic 
case with Yee's performance measure. Before we do so though, 
we briefly summarize the most common stochastic routing model 
[13] and indicate why the new performance measure seems to be 
advantageous . 

A. background” 

Our point of departure is the original (cf. Chapter II) 
i-link, n-node model for a communication network. Data entering 



In this section we closely follow the discussion in [13] . 
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the network from external sources forms a Poisson process with 
a rate of a^. (messages per second) for those messages entering 
the network at node i and destined for node k. All messages 
are assumed to have lengths that are drawn independently from 
an exponential distribution with mean 1/y (bits) . The combined 
effect of finite link capacities and random fluctuations in the 
actual arrival rate of messages to the network causes queueing 
delays. In order to accommodate these queues we assume that 
all nodes in the network have unlimited storage capacity. At 
any given time, the state of the network (or its congestion) 
is described by the set of data queues. 

With each link [i,j] e we associate, in addition to its 
capacity, c^ ^ , a queue q^ of all messages waiting to be trans- 
mitted over that link. The routing of messages (flow pattern) 
in the network is accomplished by determining for each node 
what fraction of the incoming traffic, for each commodity (i.e. 
destination) , is to be directed to which link queue. 

other carmodities 




c. . 
ID 



-> 



to node j 



Fig. VI. 1. Schematic Representation of Node-Link 
Queueing Model 
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The data rate conservation equations for any node i, i £ V 
can be written (with the help of Fig. VI. 1) as 



l f -i - l --- 

j (^i) j (^i) ^ 



f k . 



a if ¥ ( i , k) £ N q 



(VI. 1) 



and the routing variables are defined by 



a 



f k . 



il 



f k 



l nl 

j (ri) D1 



, k 
+ a . 
1 



* [ i , j ] e L Q , vk 



(VI .2) 



We are now faced with analysis of a network of queues. A 
similar problem was studied by Jackson [14], and he was able 
to establish that an imbedded queueing and serving facility 
offered a solution identical to the same facility acting inde- 
pendently from the network, but with Poisson arrivals at a 
rate offered by the network. In order to apply this remarkable 
result here it is necessary to assume that every message, once 
it arrives at its intended queue q^ , has its length randomly 
selected anew from an exponential distribution with mean 1/y . 
This destroys the dependence between interarrival and service 
(transmission) times. This assumption was studied extensively 
by Kleinrock in [15] , with the conclusion that the so-called 
"independence assumption", albeit rigorously unjustified, 
leads in practice to useful results. 

With the independence assumption, we see that any link 
[i,j] e Lq is now representable as an m|m| 1 queue with Poisson 



Detailed study of m|m| 1 queues can be found in any basic 
text on queueing theory. 
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arrivals of rate f . . = [ f*. and exponential service rate 

3 k 3 

with mean 1/yc^j. For notational simplicity we will assume 
that all capacities in the network include the factor y, and 
thus the mean service (transmission) time of a message over 
link [i,j] is 1/c^. In what follows we assume steady-state 
operation of the m|m| 1 system, and thus require that 



f . . < c . . 

ID ID 



(VI. 3! 



For the queueing model described above the average delay 
T of a message passing through the network is given by [13] 



T = — 



l 

[ i , j ] e L 






0 



c . . - f . . 
ID ID 



(VI. 4) 



where 



a = 



l 

(i,k) «N. 



and 



f . 

ID 



1 

k(*L) 




The most common statement of the routing problem involves 
minimization of the average delay T as the objective function, 
subject to constraint (VI. 1). Various solution methods for 
this non-linear problem have been presented (e.g. [16] through 

[20]) in past years. In [8] a different approach leading to 
a linear programming formulation was taken, namely a satura- 
tion ratio is defined for each link [i,j] € L Q , and 
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the worst of them is minimized. This procedure is then 
iterated until all saturation ratios have been minimized. 

When implementing any of the above methods in actual routing 
control it is necessary to update the estimates of input data 
rates more or less often (depending on the nature of external 
data sources) , and to recalculate the routing variables in 
order to adapt to possible changes. It should be noted that 

in (VI. 4) the flow rates {f^}, and respectively the routing 

k k 

variables {cu^} depend only on the input rates {a^} and not 

on the actual congestion { < 3 ^ j } in the network at the update 

time. It is reasonable that inclusion of global congestion 

information in determination of the routing variables should 

improve the adaptivity properties of any routing methodology. 

In particular we follow [12] in suggesting the expected time 

needed to empty a queueing system as a practical performance 

measure which uses congestion information. 



B. ON THE EXPECTED TIME TO EMPTY A QUEUEING SYSTEM 

In this section we will derive (following Yee) the formula 
for t-, , the expected time needed to empty, for the first time 
an M | M | 1 system. 

The first question in this respect that we wish to answer 
is: If a message arrives to an empty system, how long will 

it take, on average, before the system becomes empty again? 

Some thought will show that this is exactly the expected length 
of a "busy period" t^, which is known to be for m|m |1 

1 



c-a 



(VI. 5) 
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where a and 1/c are the arrival rate and the expected service 
time, respectively. 

Now, suppose we look at a queueing system and find (q-1) 
messages awaiting transmission, and one message being trans- 
mitted. Let us agree to put any message that arrives from now 
on in buffer (b) (see Fig. VI. 2) . Also, we will always empty 
the (b) buffer prior to servicing the (a) buffer. 

a 




Fig. VI. 2. Queueing System 

It is clear that the next message in buffer (a) must wait, 
before beginning transmission, the length of a busy period 
(VI. 5). (We note that the change in queueing discipline that 
we introduced does not affect the distribution of busv/idle 
periods for m|m| 1.) Following the same argument it is clear 
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that the system becomes empty for the first time after 
waiting, on average. 



t 




_S_ 



(VI. 6) 



1 



c-a 



We summarize this part of our discussion in the following 
lemma . 

Lemma VI . 1 

The expected time needed to empty, for the first time, 
an M| M| 1 system with q messages is 



where a and 1/c are the arrival rate and expected service time, 
respectively . 



Consider a commodity (i,k) e Nq which is characterized at 
a given moment, say t = 0, by its queue q^(0) and its arrival 



capacity resources of the network in such a way that they can 
support a constant flow rate f^ of commodity (i,k) from node i 
to node k. From our previous discussions we know that it is 
impossible to assign to commodity (i,k) more capacity than 
CS(i,k) the value of a minimal cutset separating node i from 
node k, i.e. 



□ 



rate a\ . Suppose we dedicate to this commodity a part of the 



fk < CS ( i , k) 



(VI. 7) 



This situation is depicted schematically in Fig. VI . 3 . 
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i fk<_CS(i,k) k 

Fig. VI . 3 . Queueing System for Commodity (i,k) 



At this point we can write that the expected time t. needed to 
empty, for the first time, a queue of commodity (i,k) is 



t k 

1 



q* (0) 

Tk k 
f i ' a i 



(VI. 8) 



We would like to consider the same construction simultan- 
eously for all commodities in the network. Since the capacity 
resources are limited the following constraints must be satisfied 



(i) link capacity constraint 



l 1 c , *[i,j] 6 L (VI. 9) 

k(^i) 1: 13 u 

where f^ denotes the part of link capacity that is dedi- 

cated for commodity (i,k) use. 

(ii) capacity assignment continuity 



f k . 



I f . - l _ 

j(?i> ^ j(?i> ^ 




v(i,k) s N q 



(VI. 10 
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The constraint preserves a constant total assignment, say 
f^, of network capacity to commodity (i,k) along all paths 
from node i to node k. Substituting (VI. 10) into (VI. 8) we 
obtain 

k q ? (0) 

*i = —— x r-, v(i,k) e N q (VI. 11) 

j(?i> ij j^i)* 1 * 1 

From all feasible capacity assignments that satisfy (VI. 9) 
and (VI. 10) we ask for one which has the minimal largest ex- 
pected delivery time. This is the same Min-Max criterion we 
used in the formulation of the First Minimal (deterministic) 

Time Problem. The formulation of the corresponding First 
Minimal Expected Time Problem (METP(l)) and subsequent optimi- 
zation problems are the subject of the next section. 

C. SEQUENTIAL LINEAR OPTIMIZATION FORMULATION 

With every feasible capacity assignment, {f^} we asso- 
ciate a descriptor vector T = (t^ , t 2 , . • • , t„) , M <_ j Nq j of 
distinct expected times to empty the queues. We assume, with- 
out loss of generality that the components of T are ordered 
such that t^ > tj , if i > j . Now, given two feasible capacity 

assignments F ^ and F®, we say that F^ dominates F^ iff t^ < t^ 

A B 

and t i = t„. , i = l,2,...,j-l for some j, j <_ min (M A ,M fi ) 

(cf. Def. II. 2). The definition of optimal capacity assign- 
ment now follows directly. 
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Definition VI . 1 



We say that a capacity assignment is optimal for a given 
k k 

network state (q'^(0)} and arrival rates {a^}, v(i,k) £ Nq 
iff 



m 



mm 



r I 0 0 



• / 1 J / ^ 1 , 2 , . . . , M 



(VI. 12) 



LI 



Our objective is to show that the optimal capacity assignment 
can be obtained by solving an appropriate deterministic optimal 
delivery problem with constant rate data inputs. 

We now present the statement of the First Minimal Expected 
Time Problem (METP(l), for short), in which the largest expected 
queue delivery time is minimized. 



METP (1) : min t, 

q*<0> 

Y k Y k 1' ¥(l ' k) 5 N 0 

uk) 13 j(?i> 31 1 

I i c “li.j] £ L (VI. 13) 

k(^i) 13 1:1 U 

t 1 , >. o, V- [ i , j ] £ L 0 , * ( i , k) £ N 0 



The optimal solution to problem (VI. 13) is a function of the 

initial network congestion (q^(0)} and the expected arrival 
k 

rates {a^} . This open-loop solution can be implemented, at 
least in principle, as closed-loop routing control by continuously 
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recalculating it in time, with the current network state (con- 
gestion) as initial condition for each problem. It should be 
pointed out that we do neither imply nor believe that this kind 
of implementation is possible unless the frequency with which 
a. new solution is recomputed can be adjusted to match the 
actual transmission and computation capabilities of a network. 

In spite of this fact, we will assume in the sequel that 
it is possible to recompute the capacity assignment with every 
new message arrival to the network. As a result we obtain a 
theoretical model which provides some new insight into what 
is the effect of including congestion information, in addition 
to that of arrival rates, on dynamic routing strategies. 

Following the assumption above we specify the set Nq, in 
this chapter, to include those commodities (i,k) for which 
q^(0) >0. By doing so we do not allocate in (VI. 13) capacity 

resources to empty queues (as long as they remain empty) . 

If one "deletes" from problem (VI. 13) those commodities for 
which q^(0) = 0 (the expected time needed to empty those queues 
is not well defined) , then its interpretation as a "minimal ex- 
pected time to empty" is strictly valid, and the network could 
operate for some finite time with links saturated while also 
obeying the capacity assignments. 

Using the transformation 

u ij ~ fc l f ij' * [i ' k] e L o' v(i ' k) * N 0 

and introducing slack variables we obtain the LP formulation 
of METP(l) in standard form. 
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METP (1): 



min t 



1 



s . t . 





0 



(VI. 14) 




>_ 0, * [i , j ] € L q/ *(i,k) e N q 

□ 



The reader will recognize problem (VI. 14) as a statement of 
the First Minimal (deterministic) Time Problem (cf. III. lb) 



both formulations are mathematically identical, here we inter- 
pret t^ to be the expected value of a delivery time. 

It is easy to see (cf. VI. 14) that as t-, reduces to its 
minimal value t^ a subset of links, say L-^, is bound to become 
critical. For this set of links the second constraint in 
(VI. 13) holds with equality or, equivalently, the respective 
slack variables in (VI. 14) must be identically zero. 

It can be expected that many feasible capacity assignments 
will solve problem (VI. 14). Because of this circumstance, we 
may ask for the "best" among many solutions. One way to ap- 
proach this question will be to apply the same min-max criterion 
as in METP(l) to those links which are not critical, i.e. 
to all [i,j] such that [i,j] £ . We therefore seek next to 

minimize expected delivery time , while retaining t? for 
all commodities that were assigned capacity in the set . 



with constant rate data inputs {a^} to the network. Although 
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The Second 



We denote the set of these commodities by N^. 
Minimal Expected Time Problem can then be stated as 

METP ( 2) : min t 2 



q k (0) 



lt k . - lf k . -a k 



j (^i) J ' 3 j (^i) 



qi«>) 



j (?*i) 



If. . - If . . -a? 



(?i) J 



k 

k 

t 



f k . 

&i) 13 



l f • 
(£i> 



f ^ 

2' f ij 



= t°, v(i,k) e N 1 

_< t 2 , ^(i,k) £ N o _N l (VI. 15) 

= c i j, v[i,j] e L ± 

< c iy v[i,j] e L q -L 1 

>_ o, * [ i , j ] £ Lq, v(i,k) £ N 0 

□ 



Again, using the transformation 



k A , p k 
u. . = t„f • • 

i] 2 i] 



(VI. 16) 



and rearranging results in an LP formulation 
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METP ( 2 ) : 



min t 2 



' t 2 ( 



s . t . 

q*(0) 



k. 

a i } 



l u k . 
j c^i) 



l u. . 
(£i) 1,1 



0, *(i,k) S N 1 



, k 
■ t - a . + 

2 l 



y 



k 
u . 



I 



k 
u . 



j (Pi) 13 j (^i) 31 



= q i (0) , * (i,k) 



N o- N i 



- t 



V k 

0 c . . + / u . . 

2 ^ k(k> 13 



-t_c . . + y u* . 

2 11 n 



. . . , « . . + s . . 

2 1] k(£i) ^ « 



t_ , U. . s 
2' 11' s ij 



for given t 



0 

1* 



= 0, *[i,j] e L ] _ (VI. 17) 



= 0, v[i,j] £ L q -L 1 

>_ 0 , v [i, j ] s L q , 

* (i ,k) £ N q 

□ 



It may also happen that the solution to METF ( 2 ) is not 
unique. The procedure could then be repeated by identifying 
additional critical links [i,j] and defining to be a set 
of links including the new critical links as well as those in 
. Similarly we define ^ to be the set of all commodities 
that have capacity assignments in the set . Continuing to 
iterate in this way until we have exhausted all commodities, 
we ultimately generate a capacity assignment for which (VI. 12) 
is satisfied and thus is optimal . 

For completeness, we present the linear programming formu- 
lation of the m-th Minimal Expected Time Problem. 
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METP (m) : 



min t 



m 



s . t . 



^ (0) ,k w V k 
m 1 j(£i) 13 



y u k . 

j(?i) :1 



0, * (i,k) £ N -N , , 

It ir 

p = 1,2,... , m-1 



-t a k + i u k . - l u k . 

mi j<£i> 13 j(^i) 31 



q ± (0) , * (i,k) € N Q -N m _ 1 



-t c . . 
m l j 



+ l 

k(*i) 




0, v[i,j] e L m _ 1 (VI. 18) 



t c . . 
ID 



+ l 

k(^i) 




+ s . . 



iD 



0, v[i,j] £ L 0 -L m _ 1 



t 



m 



u 



k 

ij 



for given 





1 0, *[i,j] £ L q , 

¥ (i / k) £ N q 



N 



-1 




□ 



The SLO methodology establishes a hierarchical order among 
the critical sets, as indicated in Fig. VI . 4 . The arrows 
there indicate, for a given set of links, which are the 
commodities that may (must--for a horizontal arrow) use it. 

The question of identification of critical sets (or their 
partial composition) was considered in detail in Chapter V.5 
and we need not repeat it here. 
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Fig. VI . 4 . Hierarchical Structure of Critical Sets 



The following example of a stochastic delivery problem 
illustrates some of the concepts that we have introduced in 
this section. 



Example : 




= 2 



indicated 



Fig. VI. 5. Stochastic Delivery Problem 
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Following the argumentation we used in discussion of the net- 
work shown in Fig. VI . 5 (cf. Chapter V.F) it can be shown that 
the first critical set is composed of commodity (3,4) only. 
In this case the assignment of capacity to commodity (3,4) 
is unique and shown in Fig. VI. 5a. 



Fig. VI. 5a. Optimal Capacity Assignment for Commodity (3,4) 



Commodities (1,4) and (2,4) belong to and the correspond- 

ing capacity assignment is shown in Fig. VI . 5b . The second 
minimal expected time is computed (using the values in Fig. 

VI. 5b) to be 




4 

The minimal expected time to empty the queue q^ is given by 





2-1 



5 



5 




6 





4 2.5-1 

a. 
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Fig. VI . 5b . Optimal Capacity Assignment for Commodities 
in N 2 - Nl 

We conclude this section with an observation regarding the 
optimality criterion in Definition VI . 1 . Since the mathemati- 
cal formulation of MTP(l) and METP(l) are identical we can 
interpret the stochastic delivery problem as a deterministic 
delivery problem with constant rate inputs. We could ask then 
for an optimal capacity assignment (that may change with time) 
which consists of two consistent parts, one that accommodates 
the constant input rates in such a way that the other enables 
optimal delivery of the backlogged data (in the optimal de- 
livery function sense) . Since the modifications necessary 
to make the time (MTP (m) ) and the rate (MRP (m) ) problems handle 
constant inputs are trivial, this approach would result in an 
optimal capacity assignment schedule (utilizing a sequence of 
corresponding METP's and MERP's). 
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Although our previous results indicate that this sequen- 
tial optimization approach of interleaved time/rate problems 
is more powerful than that of time problems only, we do not 
use it because of conceptual difficulty that arises between 
firm scheduling of events in time and the potential necessity 
to recompute a new capacity schedule. For example, it is possi- 
ble that in an optimal capacity assignment schedule, a queue 
of some commodity (i,k) e Nq will be assigned capacity only 
following a point in time which is beyond the recomputation 
instant. This can lead, at least in theory, to tremendous 
delays in the delivery of that queue. For this reason we find 
it conceptually more satisfactory to consider constant capacity 
assignment (as derived in this section) in our model. 

D. DISCUSSION 

In the last section we have shown that an optimal capacity 
assignment can be obtained as a result of solving a sequence 
of linear programming programs (METP's). We also have indi- 
cated that the mathematical formulation of a stochastic delivery 
problem is identical to that of a corresponding deterministic 
problem with constant rate data inputs. Due to this similarity 
we can apply the theory developed in previous chapters to derive 
and understand the structural properties of an optimal solution. 

The derivation of routing variables has been studied mainly 
in two extreme situations. In the first case only the steady- 
state arrival rates of messages are taken into consideration. 

The performance measure objective usually is to minimize expected 
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delay experienced by a message traversing the network or, as 
in [8], to minimize a sequence of saturation ratios. In any 
case, the underlying network model is that of Kleinrock [15] , 
as described in Section A. In the other case, only the con- 
gestion state of a network is utilized to compute a routing 
flow schedule that attains optimal delivery function. This 

4 - 

approach is studied in detail in this thesis. The dynamic 
delivery problem introduced in this chapter, provides a theo- 
retical model which will combine both types of information, 
i.e. the expected arrival rates of messages and the existing 
congestion in a network. We combine the objective of empty- 
ing the set of initial queues with the probabilistic informa- 
tion about future expected arrival rates of messages. We 
believe that the resulting optimal capacity assignment pro- 
vides a fairly accurate analytic model for a desired dynamic 
(short term) routing strategy (routing variables) . How to 
use such routing variables (whatever their origin) in the 
implementation of an actual network control system is a com- 

JL 4 . 

plex matter and only initial ' results are available. We 
will not consider this issue here. 

We have indicated before that it is unrealistic to expect 
that the new dynamic model can actually be used to compute 
routing variables in real network environments. We do suggest, 
however, that it may prove useful in simulation studies as 

JL 

1 For relation to other results, see Chapter I. 

'See for example [21], [22] and [23]. 
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a reference against which actual routing strategies can be 
compared . 

In this connection, it is worth noting that it is also 

possible to solve the dynamic routing problem which results 

k k 

when all of the a^ (not just those for which q^(0) is non-zero) 
are involved in allocation of the {f^}. In practice this 
requires interpretation of the set in (VI. 14) and in subse- 
quent time problems as the set of all commodities. This does 
not change anything in the mathematical procedure used to solve 
those problems. The conceptual difference, however, arises 

due to the assignment of capacity resources to commodities 
]«£ 

for which q^(0) = 0. Since the message arrivals to the net- 
work are stochastic in nature, it now may happen that for a 

k 

certain period of time the assigned capacity f^ (for the com- 
modities in question) will not be fully utilized. This model 
variant, although in theory inferior to the one discussed 
earlier, is probably an acceptable compromise between the static 
and the dynamic network models. Its obvious advantage results 
from the fact that it is not necessary to recompute the 
capacity assignment with every new message arrival to the net- 
work but rather as frequently as the actual computational 
facilities allow it. Finally, we mention that the new stochas- 
tic delivery model seems to be free from the "independence 
assumption." Moreover, observe, that if all the q^ are set 
equal to one, the resulting (static) solution optimizes the 
objective function which (’sequentially) seeks to minimize the 
maximum expected length, of the queueing system busy periods. 
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VII. APPLICATION TO NETWORKS WITH TRAVERSAL DELAYS 



A. INTRODUCTION 

Up to this point we have considered multicommodity delivery 
problems for which the delay in delivery was caused by finite 
capacity of network links. A natural extension of this model 
is to consider networks with traversal delays. Association 
of traversal delay with each one of the links complicates the 
mathematics of the optimal delivery problem, but provides a 
considerably improved model for transportation applications. 

The classical transportation problem (see, for example, 

[7] ) refers to the shipment of assets from a set of sources 
to a set of destinations, to satisfy given demand at minimal 
cost . An important class of extensions of this problem recog- 
nizes the existence of queueing and traversal delays, and conse- 
quently looks into the question of minimal time demand satis- 
fiability. We prefer to view this issue in a more general 
framework of Minimal Time Redistribution Problem (MTRP) ; given 
initial and desired distributions of assets, in some geographi- 
cal locations, the objective is to redistribute the assets 
accordingly in minimal time. Thus from our point of view 
there is no inherent distinction anymore between "source" and 
"destination" nodes. 



4 * 

'We use "asset" instead of the more common term "commodity" 
to distinguish it from our definition of commodity in Chapter 
II. There commodity was identified with destination node, 
where here one type of asset may be demanded in many locations, 
and a location may have demand for many types of assets. 
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An obvious and important application of this class of 
problems is to military logistics planning. In particular, 
assume that an outbreak of hostilities in a number of locations 
requires redistribution of assets (troops, tanks, supplies, 
etc.) in minimal time. The same model may be used for supply 
of aid to disaster-struck areas or for transportation of 
perishable supplies, and many others. 

The usefulness and applicability of minimal time problems 
has attracted great attention (see [24] for survey and exhaus- 
tive list of references) . Most of the research, however, has 
been done in the area of bi-partite transportation networks. 
Hammer [25] provided an algorithm to solve a single asset, 
uncapacitated minimal time problem. Tapiero and Soliman [27] 
have treated the multi-asset version of the capacitated minimal 
time problem as an optimal control problem, using a maximum 
principle and a continuous state-space framework. Their paper 
does not contain proof of their algorithm. Bookbinder and 
Sethi [24] use basically the same approach but elaborate more 
on the mathematical programming aspect of their algorithm, 
for which only convergence to a local minimum is assured. In 
both cases it is unclear whether or not the algorithms are 
computationally manageable for problems of practical size. 

In [24] an important observation is made, namely that at 
least for bi-partite transportation networks, capacity linking 
constraints (to be discussed in the next section) cause most 



'For similar results see [26]. 
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of the complexity in MTRP . The authors predict there that it 
may not be easy or even possible to include a capacity linking 
constraint and still provide a linear programming formulation 
of the problem. In this chapter we study this question and 
come to a conclusion that Sequential Linear Optimization 
methodology can be used to solve MTRP. Also, we analyze the 
special nature of capacity linking constraints and their influ- 
ence on solution procedure complexity. Then we consider 
possible extension (by discrete time modelling) of the results 
to general networks. Application to military decision problems 
is provided in the formulation of the Maximally Delayed Decision 
Problem (MDDP) . 

B. TRANSPORTATION NETWORK MODEL 

1 . Topological Representation 

A useful way to view the redistribution of assets over 
a set of locations is in terms of a network model composed of 
nodes and links. The links represent unidirectional means of 
asset transportation and the nodes represent physical locations. 
A typical transportation model is shown in Fig. VII. 1. 

With each link we associate a traversal time, i.e. 
the time required by the corresponding transportation mode 
to traverse the distance between the locations represented by 
the head and tail nodes of that link, respectively. 

In general, we allow for a variety of capacity con- 
straints, the most common of which concern loading, unloading 
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Fig. VII. 1. Transportation Network 

and link capacities. 1 The loading and unloading constraints 
(sometimes referred to as "linking constraints") provide an 
upper bound on the volume of assets that can be loaded or un- 
loaded (in general, with respect to particular transport mode) 
at a given location per unit time. The link capacity constraint 
represents the upper bound on the volume of transportation mode 
and thus on the total amount of assets per unit time that can 
be sent over that link. 

With each node we associate, at every interval of time, 
the amount of assets stored at the corresponding location. The 
collection of these descriptors for all the nodes in the net- 
work and for assets in transit constitutes the state of the 
system. 



One also may consider an upper bound on the amount of 
assets allowed at any given time at a particular node. 
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Since none of our results is dependent on the number 
of asset types nor on the number of different transportation 
modes we will, for the sake of simplicity, limit the notation 
to represent a single type of asset and a single mode of trans- 
portation. Generalization to more than one type of each is 
straightforward. Furthermore, since most of the notation and 
the meaning of network parameters are the same as in Chapter 
II, we will keep our discussion brief whenever possible. 

Consider a transportation network G(V,Lq), where 
V = {l,2,...,n} is a set of n nodes and Lq = { [ i , j ] } is a 
set of l links. We also define: 



q. (t) = amount of asset stored at node i at time t, 

1 *i s V; 



f . . 



(t) 



rate of asset flow leaving node i on link 
t i , j ] at time t, v- [i , j ] e L Q 




b . 
3 




capacity of link [ i , j ] (or of the transpor- 
tation mode represented by that link) , 
r[i,j] e L q 

loading capacity at node i, v-i € v 



unloading capacity at node j , vj e V 

traversal delay from node i to node j along 
link [i,j], v[i,j] € L». 



We reserve the use of respective capital letters for set and 
vector notation, interchangeably. For example, the quantities 
of assets stored in network nodes at time t are given by 
Q ( t ) = (q 1 (t) ,q 2 (t) , . . . ,q n (t) ) . 
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2 . Dynamic System Equations and Constraints 



The quantities just defined must satisfy three basic 
constraints: non-negativity, conservation and capacity. The 

non-negativity constraint states that 



fij(t) 1 0 Mi,j] € L q , *t, 

q^ ( t) ^ 0, ’•‘i € V, vt. 



(VII. 1) 



The conservation constraint may be written as 



q i (t 2 ) = q i (t l } / ( l f.-(a))dot 

j (^i) 3 

t„ 



(VII. 2) 



+ f ( 7 f . . (a-x . . ) ) da , ^i e V 

t/ j(£i> ^ ^ 



and 



Constraint (VII. 2) accounts for the fact that flows arriving 

at node i, i € V over link [j,i] at time t, left node j at time 

t-x . . , where x . . is the traversal delay associated with link 
Ji ll 

[j,i]. Finally, the capacity constraints are 



f i j (t) 1 c i j, * [ i / j 1 € L q , vt 



j f . . (t) < a. , vi e v (VII. 3) 

j(£i> 13 " 1 
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€ V 



j 



L f n (t) 
(^i) D1 



b . 

3 



f 



Definition VII. 1 

A set of flows F(t) is a feasible flow schedule if it 
satisfies ( VII . 1) - (VII . 3) for all t. 

n 

Let Q Q and Q denote the initial and the desired 
(terminal) distributions of assets (network states) , respec- 
tively. We say that is reachable from Q Q if there exists 
a feasible flow schedule F(t) , tg <_ t £ t^ such that F(t) : 

Q 0 (t ) Q^(t^) and 0 <_ tg < t 1 < 05 . 1 Consequently, for any 

such pair (Qg,Q-^) there is some minimal value of t^. We 
define the minimal redistribution time t^ as 

t? = min (t,|F(t): Q n (0) - Q, (t, ) } (VII. 4) 

1 (F (t) } 1 0 11 

Definition VII. 2 

We say that a feasible flow schedule F(t): Q Q (0) - Q-^(t^) is 
an optimal solution to the minimal time redistribution problem 
if t^ = t^ . 

□ 

C. BI -PART ITS NETWORKS 

1 . Problem Statement 

In this section we study the minimal time redistribution 
problem on bi-partite networks. A bi-partite network is one 

~We of course exclude the trivial case where Q Q = Q,. Also, 
we assume without loss of generality that the initial time tg 
is identically zero. 
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whose node set can be partitioned into two subsets S and D, 
so that each link has its head node in S and its tail node in 
D. A typical network of this nature is shown in Fig. VII. 2. 




Fig. VII. 2. Bi-partite Network 



It is customary to associate the set S with "supply" 
nodes, and the set D with "demand" nodes. Various amounts of 
assets are stored initially at each of the I = |s| supply nodes 
and there is a specified requirement for assets at each one 

A 

of the J = | D i demand nodes. Following our notation we write: 



A 

Qq ( S 1' S 2'.».' S I'0'0'...'0) 

( — , . . . , dj ) 



(VII. 5) 



The notation (-) indicates "don’t care" situation. It is not 
important how many assets remain in the supply set S (as long 
as these are non-negative quantities) . 



171 






We can restate now the Minimal Time Redistribution 
Problem as follows: 

For any given pair of system states (Q q/ Q 1 ) and net- 
work parameters T = { x . . } , C = { c . . } , A = {a.}, B= { b . } , 

1 ]] 1 J 1 [] 

where i = 1,2,..., I and j = 1,2,...,J, find a minimal time 
flow schedule. 

2 . Structure of the Minimal Time Flow Schedule 

In this subsection we analyze the structural properties 
of the minimal time flow schedule. We derive a result which 
parallels that of Thm. II. 1 and enables us later on to formu- 
late the minimal time redistribution problem in LP form. We 
start with the trivial but important observation that 

Lemma VII.l 

Let F (t) , 0 < t < t. be a feasible flow schedule such that 
F ( t) : Q q (0) Q 1 (t 1 ) . Then we may always take 



t, — x . . < t < t, , if x . . < t. 

-J 1 11 1 



£ ij( t) = 0 



/ t - —T . 

i * i: 

^ 0 £ t < t 1 , 



* (i , j ] e L 



0 



(VII .6) 



if x . . > t. 
ij 1 



Proof : 

Consider a bi-partite network (like that shown in Fig. VII. 2) 

and assume that there is some feasible flow solution F(t), 

0 < t < t x such that F(t): Q Q (0) -*■ Q 1 (t 1 ). It is quite obvious 

that this flow schedule cannot use any link [i,j] for which 

x. . > t, , since all the flows on this link will arrive at their 
1 1 1 
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destination j later than t 1 , and thus be of no use in the con- 
text of the minimal time problem. Also, there is no point in 
sending flows over a useful link [i,j] (x^ < beyond time 

because they will not reach their destination in time. 

r 

Combining (VII. 2), (VII. 5) and (VII. 6) we can express 
the desired system state with respect to the demand nodes as 



l 




fj_j (t) dt, 



V’ j £ D 



(VII. 7) 



Similarly, the non-negativity constraint (VII. 1) with respect 
to the supply nodes can be written as 



s 



i 





f i j (t) dt , 



*i € S 



(VII. 8) 



The minimal time redistribution problem reduces to 
finding a flow schedule which satisfies (VII. 7) and (VII. 8), 
subject to capacity constraints, in minimal time. 

We now show that the search for a minimal time flow 
schedule may be confined similarly to the optimal delivery 
problem, to the class of piecewise constant flow schedules. 
Furthermore, it is possible even to narrow this class to flow 
schedules which we call linking flow schedules . In order to 
present this subclass we need to introduce some additional 
notation. 

For a given bi-parti te transportation network we define 
for each supply node i, i £ S a vector = (x^ (1) , x^ ( 2 ),..., x^ (n. ) ) 
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of all distinct traversal times associated with outgoing links 

of that node. The components of are assumed to be ordered 

so that t . ( k) < t . ( r) if k < r < n. , and n. is the number of 
1 1 — 1 l 

vector components. By n^ we denote the ordinal position of 

an element of T. such that t. ( n. .) = t. .. For the network 
l i ID ID 

in Fig. VII. 3 we have 
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We now use this example to demonstrate the structure 
of a linking flow schedule. 




r\*/ 






Fig. VII. 4. 



Linking Flow Schedule 



( t. > max x . . ) 

1 T ^ 
L 0 



The length of a horizontal line in Fig. VII. 4 expresses the 
time duration of effective flows on that link (Lemma VII. 1). 

The labels above a line identify the constant segments of a 
flow. The crosses (or corner points) indicate the time instances 
at which the flow may change its value. We do not consider 
flow termination points as corner points in this context. 



We consider loading and link capacities. Unloading 
capacity constraints are studied later on in this chapter. 
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The flow schedule in Fig. VII. 4 was obtained by using 



the following construction rule. 

Construction Rule : 

A flow' on a link [a,b] has a corner point at time t iff 

link [a,b] is linked by a loading capacity constraint to some 

other link [c,d] such that t = t. -t and t . > t , . 

1 cd' cd ab 



Now we are in position to formulate a general descrip- 
tion of a linking flow schedule for the case when t. > max t . . , 

[i,j] 13 

i.e. all the links are usable. 



Definition VII. 3 

A feasible linking flow schedule F(t) , 0 £ t £ t^ is described 



by 



f ±j (1) , 0 £ t £ t 1 -T ij (1) 



f ij (t) = ( f i j (m) , t 1 -T i j (m-1) < t £ t 1 ~i i j (m) 



(VII. 9) 



f . . (n . . ) , t. -x . . (n . .-1) < t < t. -t . . (n . . ) 
' i] i] 1 l] i] - 1 ID ID 



where T. = (x..(l),...,T..(n.)) is a vector all distinct 
1 id id 1 

traversal delays of links linked to [i,j] by a loading con- 
straint, v[i,j] s Lq . Also, we define . (0) = t^ . 



u 



T Of each of the asset-types, in multiasset case. 
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For notational convenience, we define 6 ^(m) to denote the 
duration of the m-th flow secrment f . . (m) , 

i] 

<5 . (m) = t . . ( m-1) -x..(m), m=l,2,...,n.. (VI I. 10) 

l 13 13 13 

Since our interest lies, as indicated before, within 
the class of linking flow schedules, it is useful to rewrite 
the constraints (VII .1) - (VII . 3) (we also use (VII. 7) and 
(VII. 8 )) as they apply to linking flow schedules. 

(i) — non-negativity 

f i j (m) >_ 0 , * [i , j ] e L q , m= l, 2 ,...,n. . 

n . 

„ 13 

s • > l f • • (m) 5 . (m) , '-‘l e S 

1 — . u . 13 1 

3 m=l J 

(ii) — conservation 

n i ’ 

d. = l l f.. (m) 5 i (m) , ¥ j £ D 

J i m=l J 

(iii) — capacity 

(m) < c i j, ¥ [i , j ] e L q , m = l,2,...,n i j 

(VII . 13) 

7 f . . (m) < a., vies, m=l, 2 ,...,n.. 

j i) “ 1 ^-3 

Finally we state and prove the main result of this 

section . 



(VII . 11) 



(VII. 12) 
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Theorem VII. 1 



Let Qg and be any two states of a given bi-partite trans- 
portation network such that Q^(t^) is reachable from Qg(0) by 
some flow schedule F(t), 0 <_ t <_ t^ . Then there exists a 

A 

feasible linking flow schedule F(t), 0 <_ t <_ t^ such that 
F(t) : Q q (0) - (t x ) . 



Proof : 



Define (for useful links) 



~ , A 1 

f • ^ (m) = t — 7— r- 

13 0 i m) t-T..(m-l) 



t. -t . . (m) 
1 i] 



f i j (t) dt , 



(VII. 14. 



¥ [i , j ] £ L g / m — 1,2,..., n^ . 



If we start now in state Q Q (0) and apply the new flow schedule 

A 

F(t) as defined in (VII. 14) , the system will be transfered by 

A 

time t^ into a new state, say Q-^(t^) (cf. VII. 12) , such that 



n . . 
iD 



i (t, ) = l l f ii (m) 6 . (m) , ¥ j € D 

3 1 i m=l J 



(VII .15) 



Substituting (VII. 14) into (VII. 15) results in 



t -T . . 

^ 1 13 

d. (t ) = l J f . ^ (t)dt, vj £ D 

31 i 0 



'13 



(VII . 16) 



and from (VII. 7) we conclude that 



dj (t L ) = dj (t ] _) , ¥ j 6 D 



(VII . 17) 
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Equation (VII. 17) is essentially the desired result 

A 

but we still must show that F(t), as defined in (VII. 14), 
satisfies constraints (VII . 11) - (VII . 13) . The first part of 
(VII. 11) is trivial due to the requirement f^ (t) >_ 0, 

^[i,j] e Lq , '•‘t. The second part of this constraint is shewn 
to be satisfied by substituting (VII. 14) into it and comparing 
the result with (VII. 8). 

To show that f„ (m) <_ c^ ^ , *[i,j] £ Lq , m = 1,2, ...,n^ 
we conclude from (VII. 14) that 



f..(m) < max { f . . ( t ) } , (VII. 18) 

1D [t 1 -x ij (m-1) ,t 1 -x ij (m) ] 1D 

m 1 , 2 , . . . , n . 

ij 

But since by assumption the right hand side of (VII. 18) must 
satisfy the link capacity constraint, so must f^j (m) . 

To show that the loading constraint holds for the new 
flow schedule, we write (by assumption) 



l f • ^ (t) < a. , *i £ S, vt 

V — 1 



(VII . 19) 



Integrating both sides of (VII. 19) over the interval [t^x^ (m-1) , 
t^-x^j (m) ] , for any m such that 1 £ m £ n^ results in 






6 i (m) 



t. -x . . (m-1) 

1 ij 



< a ± . 



(VII .20) 



^i € S, m — 1,2,..., n^ j 
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But (VII. 20) can be written as 





/ 





£ a i (VII. 21) 



v i e S , m = 1 , 2 



A • • • / 




which completes the proof. 



G 



An obvious consequence of Thm. VII. 1, with respect to minimal 
time flow schedules, is given in the following corollary. 

Corollary VII. 1 

If there exists a feasible minimal time flow schedule then 
there also exists a feasible minimal flow schedule of the 
linking type. 



It is worth noting the difference between the optimal solution 
to MTP ( 1 ) for a network without traversal delays, and the 
minimal time flow schedule here. In the first case it was 
sufficient to consider a constant flow schedule, whereas here 
we need a piecewise constant solution, which serves as a first 
indication of higher complexity of delivery problems on net- 
works with traversal delays. 

3 . Solution Algorithm 

Armed with the results of the last subsection we may 
state the Minimal Time Redistribution Problem as fellows . 



□ 
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MTRP : 

s . t . 



min t. 



n . . 
iD 



I l f j_j (m) 6 i (m) = d . , *j e D 



i m=l 



n . 
iD 



I l f i j(m)5 i (m) £ s i , y-i 



(VII. 22 ; 



j m=l 



f ± j (m) < c i= j *[i,j] £ L q , m = 1,2, ..^n^ 



f i j (m) <_ , *i e S, m = l,2,...,n i j 



t 1 > f i j (m) >_ 0, * [i , j ] e L q/ m= 1,2,...^^ 



We have assumed that t? > max{i . .}, i.e. that all links are 

1 L 13 

usable. ® 

Inspection of the first two constraints of (VII. 22) 
shows that in both the coefficient of f^(l), '-‘[i,j] e Lq 
has the form (VII. 10): 



<5 i ( 1 ) = t 1 - T i (1) , *i € S 



The value of this coefficient is unknown since it is a func- 
tion of the variable t^ . Define 



u (1) = f . . (1)6. (1) , v[i, j] € L 

1 J ± J -L U 



(VII. 23 ; 



Using (VII. 23) and rearranging (VII. 22) results in 
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MTRP 



min t. 



s . t . 



n . . 
iD 



^u..(l) + l l f (m) <5 . (m) = d . , v j e D 

i 3 i m=2 13 1 3 



n . . 

in 



I u i • (1) + I l f i • (m) (m) 



j m=2 



< s . , e S 
— 1 



(VII . 24 ; 



_t l c j + u i3 (1) 



< -T i (l)C ij , v[i,j] € L 0 



f . . (m) 
13 



1 C ± y V[i,j] € L q , 

ill 2 , n • 1 

ID 



'Vi + l u ij a) 



<_ -v (1) a i , vi € S 



l f . • (m) 

. n 



£ a^ , vi € s, m = 2,3,. 



. ,n 



iD 



•i / (1) , f i; . (m) >_ 0, v[i,j] e L q , m = 2 , 3 , . . . , n ± j 

□ 



which is a linear programming problem. 

It should be noted that the formulation in (VII. 24) 
is valid only when t^-x^(l) > 0, *i e S which makes the inverse 
transformation of (VII. 23) meaningful. But this is taken care 
of by the assumption that t!? > max {x. . }. Let 

-L- T ID 

L 0 

T = ( x ( 1) , . . . , x (n) ) be the vector of all distinct traversal 
delays of the bi-partite network. The components of T are 
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assumed to be in descending order of their size 
their number. Thus for example the statement: 
is equivalent to 



and n is 
t!? > max { x . . } , 

T 

L 0 



t 1 > T (1) 



(VII. 25) 



Suppose now, as may be the case, that t^ < t ( 1) , and 



in particular that 



T (k+1) < t^ < t ( k) 



(VII .26) 



for some k, 1 £ k <_ n-1. It should be clear that the solution 
to MTRP will yield (due to the nonnegativity of u^ (1) , 

*(i,j] € L q ) 

tj = T ( 1 ) (VII. 27) 



Equation (VII. 27) suggests itself as an indicator of the fact 
that t^ < t( 1). We may think of solving MTRP again, but this 
time we "remove" all the links for which x^j = t ( 1) . It may 
happen now that t^ = x(2) , in which case we repeat the proce- 
dure with respect to links for which x. . = x(2) . If 
x(2) c t^ £ x(l) then we have found an optimal solution. 



Definition VII. 4 

The m-th, m >_ 1 , Minimal Time Redistribution Problem (MTRP (m) ) 
is equivalent to MTPR for which all the links [i,j] € Lq, such 
that x. • > x (m) are considered to be not usable. 

□ 
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Actually, we are free to search for t^ in any order, 
and in particular we may implement a "binary search" technique 
[28] . The resulting algorithm will have the following form: 



Algorithm : 



Loop 




Solve MTRP(m) 

if t^ = t (m+1) then m «- m + 
repeat loop. 

if t^ > t (m) then m +■ ^ , repeat loop. 




else stop, 



(VII. 28) 



where n is the number of distinct traversal delays in the 
network and r*i denotes the ceiling (i.e. the smallest 
integer >_ X) of the number X. 

C 

Since the complexity of a "binary search" is logarithmic with 
respect to the number of elements being searched we conclude 
that 



Lemma VI I. 1 

The MTRP can be solved in 0 (lg 2 n ) number of steps, each 
being a solution of an LP, where n is the number of distinct 
traversal delays in the network. 

□ 

In the next subsection we give a simple example of MTRP. 
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4 . Example 




Fig. VII. 5. Minimal Time Redistribution Problem on 
Bi-partite Network 

The MTRP shown in Fig. VII. 5 was solved using the methodology 
of the last subsection. The resulting minimal time flow schedule 
is shown in Fig. VII. 6a. We find it useful to present the 
same flow schedule from a demand node point of view, i.e. 
with respect to the arrival time. This is done in Fig. VII. 6b. 

We conclude the example with the observation that the existence 
of unsaturated links and/or loading constraints (cf. f ?1 (1), 
f 22 d)» f 23 ( 2 )) in the optimal solution suggests the optimal 
delivery function as the final goal of optimization. We leave 
this point open for a future study. We will touch again upon 
this issue when we consider discrete time networks. 
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t 




Fig. VII. 6a. Minimal Time Flow Schedule (flow departure) 
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f 21 (D=0.67 
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Fig. VII. 6b. Minimal Time Flow Schedule (flow arrival) 
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5 . Introducing Unloading Constraints 

Up to this point we have considered the MTRP (on bi- 
partite networks) with link and loading capacity constraints 
only. In this subsection we introduce the unloading constraints. 
We will use the network in Fig. VII. 3 for illustration purposes. 

The unloading constraint introduces linking of the 
flows with respect to their arrival time at demand node set D. 

The loading constraints had the same effect with respect to 
the departure time from supply node set S. Fig. VII. 7 shows 
the unloading linkage of flows. (Note that from a demand node 
point of view, a flow on link [i,j] commences at time and 

terminates at time t^ . ) 



b. 


fn (t) 




ind) 




f ll (2) 
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) - 














f 21 (t) 








f 21 (1 > 
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f f 12 (t) 






fl 2 d) 








' f 22^ 




f 12 (1) 


W 2) 








( f 23 (t) 
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f33 (1) 


f 33 (2) 




















0 


" ■ 

3 


5 7 


8 


10 


t 



Fig. VII. 7. Linking by Unloading Constraints 
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When both loading and unloading constraints are in 



effect, problem formulation is complicated by the requirement 
that the two grids of corner points, namely that in Fig. VII. 4 
and that in Fig. VII. 7 must be consistent ; if any flow variable 
changes value at a particular point of time (corner point) , 
then all other flows linked to it (now by both constraints) 
must also be allowed to change . Consider for example the 
artificial network in Fig. VII. 8. 




c ij = c, v[i,j] e L c 



Fig VII. 8. Network with Linking Constraints 

The sequence of plots below illustrates the procedure of find- 
ing a consistent flow schedule. In each figure, the crosses 
identify already established corners, while the circles denote 
new ones . 

After some thought the reader can convince himself that 
if the traversal times (and/or the solution time t^) are 
incommensurate , the number of corner points would be infinite, 
in which case the solution is not piecewise constant. This 
difficulty may be overcome by approximating the continuous time 
axis by a finite sequence of discrete time values with some 
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Fig. VII. 9. Linking Flow Schedule 



resolution At, At > 0. We note that the same reasoning applies 
to general networks with traversal delays and hence defer further 
discussion of discrete time networks to the next section, where 
we no longer restrict consideration to the bi-partite network. 

D. DISCRETE TIME APPROXIMATION 

In this section we briefly discuss a discrete time approxi- 
mation of a minimal time redistribution problem. We have shown 
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already that this approximation arises naturally in the con- 
text of bi-partite networks with both loading and unloading 
constraints. The same reasoning applies to general networks. 
Hence we must assume that the corner points of a minimal time 
flow schedule may occur at any integer multiple of some basic 
unit of time At, At > 0 . 

It is worth mentioning that for general networks the number 
of corner points in a minimal time flow schedule can be very 
large, even if only link capacity constraints are present. 

This is so since a flow over any link in the network has to 
reflect all the possible time patterns of flow arrivals (in- 
tended for that link) to the head node of that link. Although 
this phenomenon is unrelated to the notion of commensurabili ty 
its effect for large networks may be in practice the same. 

We start by breaking a given interval of time [ 0 , T 3 , where 
T-At < t]_ £ T, into k = T/At parts. A feasible flow schedule 
F(t) , 0 £ t <_ t^ is assumed to be constant throughout each 
segment of duration At. Also, the traversal delays are approxi- 
mated to the next nearest integer multiple of At. Thus from 
here on we will interpret as the integer specifying the 

number of basic time units At which make up the traversal time 
from node i to node j . We use the following notation for the 
initial and desired states (i.e. distribution of assets) of a 
network: 



Q 0 (s l' s 2' * * * ,s n* 



— (d]_ ' d2 , • • • / d n ) 
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and also the convention 




(r) 



q ± (r) 



= the amount of assets shipped out of node i, 
over a link [i,j] at time instant rAt, 
and arriving at node j at time instant 
(r+x^.)At, r = 0,1,.. .,k 

- the amount of assets stored at node i 

throughout the r-th interval, r = 0,1,..., k. 



We also observe that a link [i,j] can carry useful flows 
that were initiated up to and including the (k-x^j)-th inter- 
val. Any flow launched beyond this time will not reach node 
j by time k-At. 

We formulate now the minimal time redistribution problem 
as 

MTRP : Find a minimal value of a time segment index k, say k^ , 

for which the optimal value of the cost function in the 
following linear program is zero. 

LP: min a 

s . t . 



a + q i (k) 



d . , vi € v 

1 



q^o) 



+ 



l 

j (?*i) 




S i , vi € V 



q i (r ) -q i (r-l) 



l 

(?*i) 



: ii (r) ' E f -ji (r_T ji ) 
iD j(^i) D1 Dl 



0 , vi £ v, 
r = 1 , 2 , . . . , k 



"^For notational simplicity, here and in the sequel, we use 

r = 0,1, ... ,k although f . . (r-x ) = 0 , unless 0 £ r_T -:i 1 k-T -ji' 

v [i, j ] £ L q . Di Di j J 
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I f ii (r) 
j(^i) 13 



1 a i , vi £ v, r = 0,1, ... ,k 



(VII. 29) 



I f ii (r " T ii } 
j(^i) D D 



<_ b i ,vi e V, r = 0,1, . . . ,k 



fj_j (r) < c ± j, *[i,j] e L Q , r = 0,1, ...,k 

a, q i (r), f ± j (r) > 0, vi e v, v[i,j] e L Q , 

r = 0 , 1 , . . . , k 

where Qq and are given. 

n 

l_J 

It is not difficult to see that k^At approximates the 
optimal value of the minimal time t^, within one basic time 
interval . More precisely 



( k°-l ) At < tj < k°At . 



(VII . 30) 



This is achieved of course at the expense of solving the LP in 

(VII. 29) a number of times, for different values of the time 

segment index k, until the smallest value of k, say k^ , is 

discovered for which min a = 0. Using a binary search tech- 

AT 

nique (similar to (VII. 28)) results in needing 0 (lg 2 steps, 

where AT is the size of the potential range of values of t^ . 

The additional computational complexity that is introduced 
by this approximation scheme is counterbalanced , at least 
partially, by our ability to implement the notion of an optimal 
delivery function. We remind the reader that in the case of 
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exact solution (of a bi-partite network without unloading 
constraints) it was in general impossible to implement any 
requirements with respect to delivery time (the optimal delivery 
function and in particular the minimal rate problem fall within 
this category) while preserving a piecewise constant flow 
schedule . 

The discrete time version of a delivery function (compare 
with (II. 6)) is given by 

D (r ) = l q . (r) , r = 0,1, ...,k° (VII. 31) 

is D 1 

where the summation is over all nodes for which the demand 
is defined (demand set). The delivery function in (VII. 31) 
was defined for flow schedules which do not allow intermediate 
storage or, in general, the amount of assets at any node i and 
any time t cannot exceed the demand d^ at that node. In the 
redistribution problem this assumption is not true anymore 
and a generalized formulation of delivery function is necessary. 

We define 



D(r) - l w, (r) , r = 0,1, . . . ,k° 
ie D 



where 



w i (r) 



q i (r) , q i (r) < d L 
dj_, otherwise 



(VII. 32) 
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The formulation in (VII. 32) accounts for the fact that a 
surplus delivery of assets (beyond the demand d^) is not con- 
sidered helpful and thus must be disregarded. The reader will 
notice that if q^(r) <_ d^, *r, as the case is in the delivery 
problem of Chapter II, Definition (VII. 32) reduces to (VII. 31). 

Since the corner points of the minimal time schedule are 
fixed by the approximation method and the minimal time index 
solution k^, the optimal (generalized) delivery function is 
defined as follows. 

Definition VII. 5 

A delivery function D^(r), r = 0 , 1 ,..., k® is said to be 
optimal if it satisfies 

D°(r) = max {D (r) | D° (k°) , D° (k°-l) , . . . , D° (r+1) } , (VII. 33) 

F (k) 

r = k°-l, . . . , 0 

where 

D°(k°) 4 l d . 

ie D 

□ 

The sequential linear optimization procedure now consists 
of solving the minimal time problem (VII. 29) followed by a 
sequence of k°-l LP problems. The formulation of the m-th, 
m = k°-l , k°-2 , . . . , 1 problem in that sequence is derived next. 

We start by observing that 

max D(r) = min{ £ d. - D(r)} 

ieD 
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or equivalently 



max 



D (r) = {min l h . (r) } 

is D 1 



(VII . 24a) 



where 



h i (r) = d i ~ w i (r ) 



. I 



i i" q i (r) ' d i > q i 



0 , 



otherwise 



We can state now the m-th optimization problem as follows: 



min l h . (m) 
ieD 1 



s . t , 



,, 0 , 

q i (k ) 



d . , = D 

1 



q (0) + l f..(0) 
j(^i) 13 



*i s V 



qi (r) - q i (r-l) + l f^. (r) - l f ± (r-x ) 
1 1 j(^i) 13 j(^i) 3 3 1 



= 0 , vi e v, 

r = 1,2, .... ,k C 



h i (r) + qi (r) 



> d . , vis D 

— l 



0 



r = m,m+i , . . . ,k -1 



+ See (VII. 29) . 
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D°(r), r = m+l,m+2,.... 



ie D 



h i (r) 



= L di 
isD 



l f ±i (r) 

j(^i) 1] 



1 a^, u i € V, r = 0,1, ...,k 



, 0 



l f, i (r-x, i ) 1 b , **1 € v, r = 0,1, ...,k C 

j(*i) ^ 3 1 1 



(VII . 34b) 



f ij (r) 1 c i j ' ’■‘U/j] e L q , r = 0,1, ...,k 



h i (r), q i (r), f ^ (r) >_ 0, *i £ v, € L Q , 

r = 1 , . . . ,k^ 



where Qq , , k^ and (r) , r = k^ , k^-1 , . . . , m+1 are given. 

□ 



It is important to notice that the definition of h^(r) in 
(VII. 34a) is satisfied in the linear problem formulation 
(VII. 34b). The underlined constraint and the form of the cost 
function in (VII. 34b) provide for this fact. If q^(r) >_ d^, 
then the cost function will force the corresponding h^ (r) 
to be equal to zero and when q^(r) < d^ then h^(r) is exactly 
the difference between the two values. 

We use the following example to illustrate some of 
the ideas presented in this section. 
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Example : 




S D 

Fig. VII. 10. Discrete Time Redistribution Problem 



For the problem in Fig. VII. 10 the traversal times (in units 
of At) are indicated on the corresponding links. The relevant 
loading and unloading constraints are shown per unit of time 
At. This problem was solved using the methodology presented 
earlier in this section. The resulting minimal time flow 
schedule is schematically illustrated in Fig. VII. 11. 
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Fig. VII. 11. Minimal Time Flow Schedule (loading) 

The same flow schedule is shown with respect to arrival time 
in Fig. VII. 12. 




m 



Fig. VII. 12. Minimal Time Flow Schedule (unloading) 
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The optimal delivery function is shown in Fig. VII. 13. 




Fig. VII. 13. Optimal Delivery Function' 

An observation with respect to Fig. VII. 13 is appropriate here. 
In contradiction to the optimal delivery function studied in 
the main body of this thesis, here the objective function is 
no longer convex. This is still one more distinction between 
the delivery problem on networks without and with traversal 
delays . 

We have mentioned in the introduction to this chapter that 
the minimal time redistribution problem has important appli- 
cation in military logistics planning. The SLO methodology 
and the results obtained thus far allow us to extend this 
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statement beyond the classical transportation problem, into a 
domain of complex decision making processes. We study one such 
application in the next section. 

E. MAXIMALLY DELAYED DECISION PROBLEM (MDDP) 

In this section we are concerned with a particular aspect 
of the decision making process in a military environment. 

Assume initially that a possible strategy to follow has been 
determined and that the problem of interest is the redistribu- 
tion of available assets to implement this strategy. Since 
the various possible distributions of assets over a given set 
of locations constitute a state space of our model, any strategy 
implies one or more corresponding state trajectories (from initial 
to desired distribution) in that space. If there is a set of 
possible strategies under consideration, the ability to analyze 
their corresponding state trajectories can help identify which 
of these strategies is most attractive. 

Consider a military environment characterized by a network 

G = (V,Lq) and an initial distribution of assets Q Q = (s^,...,s^), 

and suppose there is a set P = (p^ /P 2 > • • • 'P^) °f M strategies. 

Each strategy is described in turn by its corresponding terminal 

distribution of assets Q , m = 1,2,...,M. We assume, without 

m 

loss of generality, that all the states Q , m = 1,2,...,M are 
reachable from Q n , i.e. there exists F (k) : Q n (0) Q_(K) for 

some K < 00 , which is called the horizon time. The decision 
maker is faced with the problem of selecting the most desirable 
(in a military context) strategy from the set P. An inherent 
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property of most military situations is the necessity to make 
decisions subject to a high degree of uncertainty (as to the 
enemy’s state, for example). It seems natural that the deci- 
sion maker should seek to delay the decision process as much 
as possible, while still ensuring that all the terminal dis- 
tributions {Q^} are attainable within the prescribed time limit 
K. By delaying the decision instant, a number of advantages 
are achieved, for example: 

(i) minimize unnecessary, sometimes irreversible, 
commitments of assets. 

(ii) maximize enemy's uncertainty as to which strategy 
is selected. 

(iii) gain time to acquire additional information which 
may influence the decision process. 

As a first step in delaying the decision instant by, say, 
k^ units of time, we consider finding a common flow schedule 
F“(k) , 0 £ k £ k^ which will transfer the system from its 
initial state Qq( 0) to some intermediate state Q‘'‘(k^) . Ob- 
viously, the flow schedule F^ (k) , the state Q^(k^) and the re- 
sulting decision delay of k^ units make up an acceptable solution 
to the delayed decision problem iff all the terminal states 

Q , m = 1,2, ...,M are reachable from Q^Ck,) within the remain- 
m 1 

ing time K-k^. This leads us to the statement of the First 
Maximally Delayed Decision Problem. 
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MMDP ( 1 ) : 



Find the largest time index say k° , for which 
the optimal value of the cost function in the 
following LP is zero. 



LP: 



s . t . 



min 



F 1 (k): Qq ( 0 ) - Q 1 (k 1 ) 

F m (k): Q 1 (k 1 ) - Q m (K) - o^, m = 1,2, ...,M 



(VII. 34) 



where = (a^ , , . . . , a^) is an n component vector and > 0 . 

□ 

To simplify the notation we have used vector formulation, 
where each of the constraints in (VII. 34) represents a short- 
hand for all the constraints in LP(VII.29) with the distinction 
that Q~(k^) here (which corresponds to = (d^,d 2 / . . . /d ) 
there) is unknown. 

It is true that as k^ increases to its maximal value k^ , 
some subset of trajectories connecting Q^(k^) to their respec- 
tive terminal states is bound to become critical, so that the 
corresponding terminal states become unreachable from Q^(k) 
for any k > k^. We denote by P 1 the subset of strategies that 
become critical at k^ . The decision to select any one of these 
strategies has to be made prior to or at time k^lt. 

If P^ c p, then we may follow the same line of reasoning 
as before to formulate a second optimization problem, which will 
let us identify the second critical set of strategies and 
their corresponding critical time. 
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MDDP ( 2 ) : Find the largest time index k~ , say k 2 , for which 

the optimal value of the cost^function in the 
following LP is zero. 



LP: 



s . t . 



min a 2 



for given 



F 1 ( k) : Q q (0) 

F m (k) : qVJ) 

2 1 0 
F Z (k) : Q"(kp 

F m (k): Q 2 (k 2 ) 

k^ , where 



- Q 1 (kJ) 

- Q m (K) , *m e P 1 

- Q 2 (k 2 ) 

- Q m (K) - a 2 , v m / P] _ 

= (a 2 ,a 2 , . . . ,a 2 ) anc ^ a 2 — 



D 



(VII . 35) 



Continuing to iterate in this way until we have exhausted all 
strategies, we will generate a finite number Mg , Mg <_ M-l of 
pairs (k^,P m ), m = 1,2,..., Mg with the following properties 

(i) 0 < k? < k° < . . . < k° < K. 

- 1 2 M o - 

(ii) P 4 n P. = 2, i , j = 1,2,...,M , i f j. (VII. 36) 

J- 3 u 

M 

0 

(iii) u = P 

i=l J ’ 

We see, as before, that the SLO methodology gives rise to a 
hierarchical structure (Fig. VII. 14) in which the solution of 
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the individual optimization problems is carried out in a 
sequential manner, and that each such solution constrains the 
solution space of problems lower in the hierarchy. 








v. 







Fig. VII. 14. Hierarchical Structure of the Strategy 
Sets w/r to Decision Instance 



We conclude this section with an example of MDDP . 
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Example : 




c.. = 2, v[i,j] € L 0 

T ij = 1 ' ¥[i '^ € L 0 

a. = b. =«. ‘•‘i e V 

1 i ' 



Fig. VII. 15. General Transportation Network 

For the network in Fig. VII. 15 the initial distribution 
of assets is 

Qq = (20,0,0,0,0,0) 

and there are two possible strategies characterized by their 
respective terminal distributions and q 2 at time KAt, where 
K = 10. 

= (0,0,0,0,0,20), Q 2 = (0,0,0,15,5,0) 

The decision maker is faced with the problem of identifying 
a flow schedule which will enable him to delay as much as possible 
the final decision as to which of the strategies he is to follow. 
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The problem was solved using the methodology of this sec- 
tion. It was found that the latest instant of time by which 
a decision which strategy to follow has to be made is k°At, 
where k^ = 4 . 




Fig. VII. 16. Hierarchical Structure of the Decision Process 

The first critical strategy set consists of strategy 
The fact that strategy p^ is not critical (and the only one 
left) indicates that once it is decided to select p^ at time 
kj = 4 , it is possible to meet the desired distribution Q, 
prior to time K = 10, say at time K* (see Fig. VII. 16) . The 
appropriate minimal time flow schedule can be found by solving 
a minimal time redistribution problem with (k^) and 

. The complete flow schedule solution to the MDDP 
in Fig. VII. 15 is given in Appendix H. 
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VIII. CONCLUSIONS 



A. SUMMARY OF IMPORTANT RESULTS 

In Chapter I we expressed the desire to obtain new insight 
into the problem of dynamic routing assignments. As an initial 
step toward achieving this goal a new performance measure for 
efficient delivery of backlogged data to their destinations is 
presented and called the optimal delivery function. The first 
important result is that the corresponding optimal flow schedule 
can be obtained by solving a hierarchical sequence of linear 
programming problems. Due to this fact the optimal delivery 
problem is computationally tractable even for moderately 
large networks. Furthermore, the well established results of 
linear programming are exploited to derive and understand the 
properties of an optimal flow schedule. Among the important 
results, at each hierachical level, the optimal flow schedule shows 

(i) A critical set of commodities that share a common 
delivery time. 

(ii) A critical set of network links that must be saturated 
by those commodities throughout their delivery period. 

(iii) The minimal rate with which saturation can be achieved. 
Another important result relates, at each hierarchy level, 

the properties of an optimal flow schedule to the optimal dual 
variables associated with the corresponding linear program. 

In particular, the composition of the critical sets can be 
uniquely identified and the minimal rate of the saturation 
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flow can be calculated, whenever the optimal solution is 
stable . 

The optimal delivery problem is then studied in the case 
of single destination networks. Two important results are 
obtained. The first states that the optimal delivery function 
is globally optimal, i.e. no flow schedule can deliver more 
commodity to the destination at any time, than the optimal 
flow schedule. The second result is the algorithm for solution 
of the single destination delivery problem. It is composed 
of a sequence of linear programs whose size is independent of 
the total number of hierarchy levels, which makes it compu- 
tationally efficient. In this context a method for identifying 
critical sets, when the optimal solution is not stable, is 
presented . 

An important result of this thesis is presented in the form 
of a new dynamic network analysis in which the optimal capacity 
assignment for routing purposes takes into account not only 
the backlogged messages but also the expected arrival rates 
of messages at the network. It is shown that the "minimal 
expected time to empty a queueing system" objective leads to 
a mathematical formulation which is identical to that of the 
deterministic delivery problem with constant flow inputs, and 
thus most of the previously derived results apply. It is also 
shown that a slight modification of the dynamic network analysis 
leads to a reasonable problem formulation which can be expected 
to provide a bound on the performance of more computationally 
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tractable routing procedures which might be implemented in 
a real network environment. 

In the last chapter a number of results concerning the 
delivery problem in capacitated networks with traversal delays 
are obtained. In particular we mention the solution algorithm 
for the bi-partite network case. 

3. AREAS OF FUTURE WORK 

Many additional areas of research appear to be ready for 
further investigation. 

One important point for future study concerns the efficiency 
of the proposed algorithm for solving the multicommodity 
delivery problem. In particular, decentralized computation capa- 
bility should be investigated for its efficient implementation 
in dynamic routing schemes. 

A further study of the delivery problem on general net- 
works with traversal delays is needed. Here the question of 
computational tractability seems to be crucial. Our results 
for the bi-partite and general networks should provide an 
appropriate starting point for this effort. 

Throughout the thesis we presented a number of conjectures. 
The questions of the number of corner points in the optimal 
multicommodity delivery function and its possible global 
optimality , in the case of intermediate storage flow schedules, 
remain open. 
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APPENDIX 



A. PROOF OF THEOREM II.l 

Thm. II.l was stated in terms of flow schedules which satisfy 
constraints ( II . 1) - (II . 3) . We prove this theorem here for a 
wider class of flow schedules, namely those that allow inter- 
mediate data queuing. More precisely, we say that a multi- 
commodity flow schedule is feasible in a wide sense (w/s) if 
it satisfies the following conditions: 



(i) f ij (t) 1 °' 6 l q and ¥t * 

(ii) q^(t) >_ 0, *(i,k) e N Q and ‘•‘t. (A.l) 



( iii) l f^-j (t) < c , v [i, j ] £ 
k(*i) 13 13 



L „ and vt 



where 



qj (t i } 



k . , , 

W 



/ { l fjj(t) - 

j(^i) 3 



l }dt. 

j(*i) 3 



The basic difference from Chapter II is that here the delivery 
rate of commodity k from node i at time t, 



r*(t) ^ l f* (t) 

1 j (?i) 13 



1 

j (ri) 



f 3i(t) 



(A. 2) 



is not restricted any more to be a non-negative quantity. 
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Theorem II.l (Extended) 



Let Q(tQ) and Q(t^) be any two states such that Q(t^) is reach- 
able from Q(t^) by some feasible (w/s) multicommodity flow 
schedule F(t) , tg <_ t £ t^. Then there exists a feasible (w/s) 

A 

multicommodity constant flow schedule F^(t) = F, t^ <_ t _< t^ 
such that F-^(t): Q ( t q ) Q(t^). 

Proof : 

Define 

^ ]_ 

f*. = z— / f^(t)dt, ¥ [i,j] e L , ¥ k (A. 3) 

13 1 “ 0 t J 

If we start now in the state Q{t^) and apply the new flow schedule 

A 

F for a duration (t^-tp) we will transfer the system into some 

A 

new state, say Q(t^) . 









I Ci>. 

j(/i) 3 



(A. 4a) 



v(i,k) e N, 



Substituting (A. 3) into (A. 4a) gives: 



< (t l> 



k , . . 

q i (t 0 ) 



/ 1 { l f* (t) - l f ^ • (t) }dt, (A. 4b) 
t Q j (/i) 3 j (/i) 3 

¥ ( i / k) e N q 



and from (A.l) we conclude that 

qj(t x ) = q^(t x ) , ¥ ( i , k) € N 



(A. 5) 
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Equation (A. 5) is the desired result but we must still show 

A 

that F, as defined in (A. 3), satisfies the constraints in (A.l) : 



(i) obvious, integration of a non-negative (by assumption) 
function results in a non-negative value. 

(ii) From (A. 4a) we have that for any t £ [t Q ,t, ] 

q^(t) = q^(tg) - (t-tg) r k , *(i,k) £ N Q (A. 6 ) 

where 



"k a 

r . = 

l 



l 

j (*U 



~\r 

f K . 

13 



l ¥ ( i / k) e N 

j(*U D 



(A. 7) 



A k 

Since r. is not a function of time we see (using (A. 5) and (A. 6)) 

k k k 

that q^(t) falls on the line segment joining q^(t Q ) and q^(t^). 

k k 

But q^(tg) and q^(t^) are non-negative (by assumption) which 
leads to 



q i (t) >_ 0, *(i,k) £ Ng, vt £ [tg,t 1 ]. 



(A. 8 ) 



(iii) Define 



i.. a i i k . 

^ k(Si) « 



(a. 9; 



We need to show that f^ £ c ij ' ^ [ i /■ j ] € Lg • Using (A. 3) we 
can write 



f i j 



t r t o t , 



/ { 



y f k .(t 

U) 13 



) }dt, V [i, j] £ Lg (A. 10 
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By assumption 



max { l f* . (t) } 

t€[t Q ,t 1 ] k(/i) ^ 




v [i, j ] 



(A. 11) 



which results in 




v [i/ j] £ L 0 



(A. 12) 



and completes the proof. 



□ 



We derive two corollaries of Thm. II. 1. 

Corollary IIJL.1 

In Thm. II. 1 let Q(t^) = 0. Then the constant flow schedule 
F^(t) = F, tg <_ t £ t-^ is feasible in the narrow sense (n/s) . 

Proof : 

Using equation (A. 6) together with the requirement that 
Q(t^) = 0, we have 

0 = qJ(t Q ) - (t 1 -t 0 )r^, v(i,k) e N Q (A. 13) 

k ^k 

But q.. (tg) >_ 0, ^(iA) e N q and thus r^ >_ 0, v(i,k) e N Q and 

there is no buildup of queues. 

□ 



Corollary II. 1.2 . 

In Thm. II. 1 let F(t) , t Q <_ t <_ ^ be a feasible (n/s) multi- 

A 

commodity flow schedule. Then F-^ (t) = F, tg £ t <_ t^ is also 
feasible in a narrow sense. 
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Proof : 



From equation (A. 3) and the definition of a net delivery rate, 
we have that 




Obviously if r?(t) >_ 0, *t s [t Q/ t 1 ] and v»(i,k) € N Q , so is 

~k 

r . . 

1 

G 

We prove now a result which is frequently used in our study. 
Lemma II. 1.1 

Let Q(tg) and Q(t^) be any two states such that Q(t^) is 
reachable from Q(t Q ). Let {F(t)}, t Q < t < t 1 be the set of 
all flow schedules such that F(t): Q(t Q ) - Q(t 1 ). Also, let 
{Ft (t) }, tg £ t £ t^ be the set of all constant flow schedules 
such that F^(t): Q(tg) ^ Q(t^). Any link [i,j] s Lg that is 

saturated in all flow schedules in the set (F^(t)} is saturated 
for the whole period [tg,t^] in all flow schedules in the set 
{ F ( t ) } . 

Proof : 

Suppose that a link [i,j] e Lg is saturated in all the flow 

/s 

schedules in the set {F^(t)}. Let there be some schedule F(t), 
tg _< t £ t^ for which this link is not saturated for the whole 
period [tg,t^]. Then by Thm. II. 1 and in particular (A. 10) it 

/N 

is possible to construct a constant flow schedule F^(t), 
tg <_ t _< ti such that F^(t) : Q(tg) > but f° r which 
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the aggregate flow f^_. < ^ , so that the link is not saturated. 

This contradicts the definition of the set (F^(t)}. 

r— 

L 

B. GLOBAL OPTIMALITY AND MULTICOMMODITY FLOW SCHEDULES 

In this section we show by counterexample that the conjec- 
ture that every optimal delivery function is also globally 
optimal is false for the multicommodity case. The counterexam- 
ple applies only to flow schedules which are feasible in the 
narrow sense, i.e. do not allow intermediate data storage. 

It is still an open question whether the same conjecture holds 
for the more general class of flow schedules, namely those that 
allow for queues buildup. 

Consider the delivery problem in Fig. B.l. 




q^(0) =60 



C ij = 

e L 0 



qg(0) =40 



Fig. B.l. Delivery Problem 



^For definition and related issues see Section A and 
Section C of the appendix. 
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Using the algorithm of Chapter ill an optimal flow schedule 



solution is obtained. 




(4,3) 

Fig. B.2. Chain 



It is described in Fig. B.2. 






28.33 < t < 55 




Flow Decomposition 




55 < t <_ 110 

of F^ ( t ) . 
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The optimal delivery function which is generated by this 



flow schedule is shown by the solid line in Fig. B.3. 




Fig. B.3. Optimal Delivery Function 



The delivery function (t) shown by the broken line in Fig. 

0 

B.3 corresponds to the flow schedule F£ (t) , 0 < t <_ t^ which 
is depicted in Fig. B.4. 



217 






We have that 



D 2 (t) > D°(t), ¥t e (28.33,44.13) 



(B.l) 



from which we conclude that not every optimal multicommodity 
flow schedule is also globally optimal. 
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C. INTERMEDIATE QUEUEING OF DATA 

In this thesis most of the results concerning the deter- 
ministic delivery problem in communications networks are derived 
in terms of flow schedules that do not allow intermediate queue- 
ing of data (i.e. that are feasible in the narrow sense ) . This 
approach avoids unnecessary complexity which could obscure 
insight into the problem. 

For completeness, we now show that the solution algorithm 
in Chapter III can be easily modified to allow intermediate 
data storage. The implication of w/s feasibility (see (A.l)) 
is that the net delivery rate r^(t). 



k , . , A 
r i (t) 



j (r i) 



f ij (t) - 



l 

j (/i) 



f k . (t) 



/ 0 



(C.l) 



is not limited any more to be a non-negative quantity. As a 
consequence the conservation constraint (II. 2) must be changed 
into 

q k (t) 4 q*(0) - / { l f k .(a) - l f k (a))da> 0, (C.2) 

1 1 0 j(/i) 1D j(/i) 3 

v(i,k) e N q , vt 

in order to account for the non-negativity of all queues at 
all times. 

Now, it is not difficult to see that the formulation of 
MTP (m) (see (III. 4)) in terms of a w/s feasible flow has the 
following form. 

"This section should be read after Section A of this appendix. 
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& IXJ II f=J C— 3 II 



MTP (m) (w/s) : 



min t 

m 



s . t . 



( l U J-; (P) “ l uMp) ) < q ^ ( 0 ) , v(i,k) £ N ( 

1 j(^i) 13 j(^i) 111 1 1 



< I u i-i (P) “ I uj.(p)) 
r n j tfi) 13 j (^i) ^ 



1 q i (0) , v (i,k) £ N 0 



n — m t in X / • • • / 2 



-t c . . + y u . (p) 

m id k 13 



0 , -* [i, j ] £ L, 



-t . c . . + T u . • ( m- 1 ) 
m-1 lj <? id 



< 0, v [i, j ] € L n (C 






. , o 

£ At p c ij' 



W [i , j ] € Lg r 
p 1,2,..., m™ 2 



■t ,p u , + y ( y u* (m-l)- l u . . (m- 1 ) ) = 0 

m - lPm " 1 (i,k)£N 0 j(^i) 13 j(Pi) 31 



, I „ ^ ,L^ U ij (P) “ , ,L^ji (p)) 



( i , k) £ N q j (j*i) 13 



j (*i) 



. . 0 0 
at P °p' 

p = 1,2,..., m- 



t + t , 
m m-1 



= t 



m-1 



u ij ( P> ' Pm' Vl 



>_ 0 , (i ,k) £ N q , 

* [if j 1 e L q , 

P 1,2,.../ m 



. 3a) 
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c 



for given t 



0 

1 



0 






0 0 
m-1 ' p m-l ' 



Inspection of (C.3) reveals that it differs from the original 
statement of MTP (m) in the form of one constraint only (under- 
lined) . A similar modification can be applied to MRP (m) 

(III. 6) to allow for intermediate data storage. 



MRP (m) (w/s) : 
s . t . 



min 



l 

(i,k) 



f k . (m) 
ij 



(t°-e ) r k (m+1) + er k (m) 
mi l 

(t^-e ) r k (m+l) 

(t^-s) r k (m+1) + 
m i 



m-1 

+ l 

p=i 



. . 0 k , . 

a Vi lP> 



er k (m) 



= q k (0) , v- (i,k) e N Q 

< q k (0) , + ( i, k) € N Q 

< q k (0) , v- ( i , k) € N Q 



(t°-e) r k (m+1) + er^ (m) 
mi l 



..0 k, 

+ l itr (p) 
p=n t 



q£(0) , + (i,k) s N Q/ 

n = m- 1 , m- 2 , 



l 

k 



f ^(p) 



< c ± . f t [i, j ] £ L q , 

P 1/2 /•«•/ m+ 1 



> r^(p) = p^, p = 1,2,..., m-1 

(i,k)eN 0 1 P 

fij(p), r k (p) > *(i,k) 6 N q , 

¥ [i/ j ] € 

p = 1,2,..., m+1 . 



. 3b) 



,2 
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- . *.0 0 
for given t^,p^, 






where 



k, , 

r ± (p) 



l f ?-i (P) - l (p) / *(i,k) e N n , p = 1,2,... 

j(*i) 13 j(^i) 31 0 



.0 _ ,0 , 0 , n n 
tp tp - , p l,2,...,m-l 



and 



e is any real number such that 0 < e 



< t° - t° 
m m+1 



The change in the form of the cost function is necessary to en- 
sure that we minimize delivery rate and not the total flow rate 
in the network. 

We conclude this section with an example of a simple delivery 
problem for which we compare the delivery functions resulting 
from both types of flow schedules. 

Example : 




Fig. C.l. Delivery Problem 
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m+1 



An optimal flow schedule solution for the problem in Fig. 



C.l is shown in Figs. C . 2a and C.2b. 





Fig. C.2a. Chain Flow Decomposition for the Feriod [0,1] 
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5 




Fig. C . 2b . Chain Flow Decomposition for the Period (1,4 ] 
The resulting optimal delivery function is shown in Fig. 

C. 3. 

Suppose now that we allow for intermediate data queueing 
and in particular consider the flow schedule in Figs. C.4a and 
C.4b. Observe that in the first period, [0 , 1 ], commodity (1,7) 
flows with rate six from node 1 to node 6 and continues 
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D(t) 



42 



12 



0 



1 2 3 4 t 



Fig. C.3. Optimal Delivery Function 





0-^0 

q^O) =6 



7 

q ( t) ( intermediate 

storage) 




Fig. C.4a. Chain Flow Decomposition with Intermediate 
Queueing for the Period [0,1] 
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Fig. C.4b. Chain Flow Decomposition with Intermediate 
Queueing for the Period (1,4] 

with rate three from node 6 to node 7. As a result, three units 
of commodity (1,7) are stored in node 6 in an intermediate 
queue denoted by qg(t). The contents of this queue are delivered 
in the second period (1,4]. 

The delivery function which is generated by the new flow 
schedule is superior (dominates) the optimal delivery function. 
Both delivery functions are displayed in Fig. C.5. 

We conclude that flow schedules which allow intermediate 
data queueing may have advantages in certain instances over 
flow schedules which are feasible in the narrow sense. Never- 
theless, it seems clear that wide-sense (w/s) feasible optimal 
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Fig. C.5. Comparison of Delivery I unctions 



flow schedules (which allow for intermediate data queueing) 
do not produce delivery functions that differ substantially in 
their basic characteristic (piecewise linear, convex, etc.) 
from those produced by narrow sense (n/s) optimal flow schedules. 

D. MORE ON STABILITY 

In this section we complete the discussion of stability 
(from Chapter IV. A. c) with examples of delivery problems that 
illustrate this concept. 

1 . Unstable Delivery Problem 




Fig. D.l. Delivery Problem 
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3 3 

For the case when q^(0) = q^CO) = q, an optimal con- 
stant flow schedule solution can be found by inspection. It 
is shown in Fig. D.2. 

q 

0 < t < q 

Fig. D.2. Optimal Constant Flow Schedule 




Formally, the MTF(l) for this problem can be written as: 



MTP(l) : 
s . t . 



min t^ 



0 10 10 
0-1100 
-110 0 1 

-10 10 0 

-10010 



0 0 
0 0 
0 0 
1 0 
0 1 



U 13 

S 12 



S 2 3 
S 1 3 



q 

q 

o 

o 

o 



(t l' U 12 



,U 23' U 13 ,S 12 ,S 23' S 13 ) 



> 0 



(D.l) 



Since both commodities have a common destination (node 3) , 
we will not use the upper index notation to indicate the destina- 
tion, i.e. u^ u^j , *[i,j] e L Q . 
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is found to be 



An optimal basic solution X ' 

B 

T 

— (^i , U 2 3 , Ui 3 , s 1 2 t Si 3 ) = (o,q/< 3 ,q, 0 ) , 



( D . 2 ) 



and the related optimal dual solution is 



A = - r B -B -1 = (0,1,0, 0,-1) 



(D . 3 ) 



where 



r 3 = (1,0, 0,0, 0,0,0). 

3 

Now, suppose that q 2 (0) = q-e, e > 0. It is not diffi- 
cult to see that in the new optimal flow schedule, commodity 
(1,3) must use the link chain ( [1, 2] , [2 , 3] ) in addition to 
link [1,3]. Therefore it has the form shown in Fig. D.3. Also, 





Fig. D.3. Structure of the Optimal Perturbed Flow Schedule 



Recall that the flow rate variables f^ are related to the 
u. .-variables by the transformation 
13 f ij = *Ci,j] € L, 



13 ' 
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J 0 ' 



it must be true that 



t° = 3 = _+ 2q-e _ e 

1 1+a 1-a 2 ^2 



(D.4) 



We can now calculate a from (D.4): 



£ 




The change A 2 in the optimal value of the cost function 
that was caused by the perturbation is 



Az 






(D. 6) 



If we use the optimal dual solution (D.3) to evaluate Az, we 
obtain 



Az = A-Ab = (0,1,0, 0,-1) • (0, ,0,0,0) T = e. 



(D.7) 



which is incorrect. We conclude that the original optimal 
solution is not stable (optimal dual is not unique) . Actually, 
the new optimal basic solution is (cf. Figs. D.3 and D.5 ) 



X B ^1 ,U 12 ' u 23 ,U 13 ' S 12^ 



, e e 

(q- 2 ' 2 ' 





e) 



(D. 8) 



■ 4 * . 

Using the law of proportions, 

a c _ a+c 

b d b+d " 
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and the new related optimal dual is 



/\ -] 

A = r B B ~ = (0.5, 0.5, 0,-0. 5, -0.5) , (D.9) 



where 



r 



B 



r 



B * 



Obviously, 

A 

A ? A. 

2 . Stable Delivery Problem 



(D.10) 




Fig. D.4. Delivery Problem 



4 4 

For the case when q^(0) = 2q and q 2 (0) = q, an optimal 
constant flow schedule solution can be found by inspection. 

It is shown in Fig. D.5. 
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Fig. D.5. Optimal Constant Flow Schedule 

Formally, the MTP(l) for this problem can be written as: 

MTP (1) : min t^ 

s . t . 
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^ ' U 1 2 ' u 13' U 2 3 ' u 14 ' U 24 ' u 34 ' S 12 ' S 13 ' s 23 ' S 14 ' S 24 ' s 34^ — — 

An optimal basic solution X n is found to be 

X B = (t l' u 12' u 13' u 23' u 14 ,u 24' u 34' s 12 ,s 13 ) 

= (q,q,0,q,q,q,q,0 ,q) , (D.12) 



and the related optimal dual solution is 



A = r B B -1 = ' (D . 13) 



where 



Tq - {1,0, . . . , 0 ) . 

4 

Now, suppose that q^(0) = 2q+e, s > 0 . With a little 
thought the reader will convince himself that commodity (1,4) 
must use link chain ( [ 1 , 3 ] , [ 3 , 4 ] ) in addition to ([1,4]) and 
( [1 , 2 ] , [2 , 4 ] ) . Therefore an optimal solution has the form 
shown in Fig. D.6. 

Also, it must be true that 



20 _ 2q+e _ _ 3q+e _ 

Z 1 ~ 2+a ~ 1-a “ 3 ~ q 3 



(D . 14 ) 



We can now calculate a from (D.14) 



a = 




(D.15) 
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2q+e 




The change A z in the optimal value of the cost function 
that was caused by the perturbation is 



Az 




q - (q +§) 



£ 

3 



(D.16) 



If we use the optimal dual solution (D.14) to evaluate Az, 
we obtain 



Az = A * Ab 



111 
3 ' 3 ' 3 ' 



0 , 0,0 



1 1 l w n 

~ 3 ' - 3 ' 3 ^ e ' 0 ' 



T 



(D.17) 



which is the correct value. Actually, the new basic solution 
is (cf. Fig. D.6 and D.15 ) 

Xg = ( t 1 ' u 12 ' u i3' u 23' U 14 ,U 24' U 34 ,S 13 ,S 23 ) 

= (q+f/q+f, §/q,q+frq + f /q+f'q'f) > (d.is) 
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and the new related optimal dual is 



A 




-1 




(D.19) 



where 



r 



B 



B* 



Thus 



A 



A. 



(D . 20 ) 



Formally, we have not shown that the original delivery 



problem in this paragraph is stable (i.e. has a unique optimal 

dual) but rather have illustrated that although the perturbation 

causes a change in the optimal basis, the optimal dual solution 

is not changed, a behaviour which is characteristic of a stable 

point. It is worth noting that further study of this example 

would show that the only unstable point here results from a 

4 1 4 

requirement vector b, such that q^(0) = ^q and (0) = q. The 
corresponding flow schedule is shown in Fig. D.7. In general, 
for a given network we expect a randomly selected requirement 
vector b (queues sizes) to be stable though the optimal primal 
solution may be degenerate. This observation is backed up by 
the experience we have gained in solving a number of delivery 
problems. This serves as an additional motivation why we are 
interested more in stability than in non-degeneracy. 
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Fig. D.7. Unstable Optimal Flow Schedule 

E. OPTIMAL DELIVERY FUNCTION IS PIECEWISE LINEAR 

In this section we show that the assumption we made about 
the piecewise linearity of an optimal delivery function is jus- 
tified. Assume to the contrary, that there exists a continuous, 
non-linear optimal delivery function. This function must be 
convex, since otherwise we could improve on it by generating 
its convex hull by the method of constant flow substitution 
(see Appendix I. A). A typical delivery function of this kind 
is shown in Fig. E.l. The broken line in Fig. E.l represents 
the delivery function which corresponds to an optimal solution 
to MTP (1) . 

Consider the optimal flow schedule F(t) , 0 <_ t _< t^ that 
generates D(t), and in particular the net delivery rates r‘^(t). 
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D(t) 




Fig. E.l. Optimal Continuous Non-linear Delivery Function 



^(i,k) e Nq at time t = t^. Define a perturbation vector AQ 
such that 



Aq i " <5r i (t l ) ' e N i' 



(E.l) 



where 



0 < <5 < 5,, 

and <5^ is the maximal value of 5 for which the perturbation AQ 
is acceptable (for simplicity we assume that the problem is 
at a stable point and thus 6^ > 0) . 

The optimal value of the cost function for the perturbed 
problem is t^-e where (IV. 20) 
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(E . 2 ) 



£ = I O k (l)Aq k 

(i / k)eN 1 1 

s 

From Thm. IV. 4 we have that any flow pattern of commodities 
in N-, that saturates the set (and in particular the flows 
R = (r^(t^)}) must satisfy the perturbation equation, i.e. 

1 = l a^llAt?) (E . 3 ) 

(i,k) € N 1 1 11 

Using (E.l) and (E.2) with (E.3), we conclude that 

e S 5 (E . 4 ) 

Equality (E.4) ensures us that it is possible to deliver 

k k 0 

the set of queues Aq^ = 5r^(t^), v(i,k) e N-^ within the period 
(t^-£,t^] by using the set of feasible flows {f^. (t^)}, 
v-(i,k) e N-, of the optimal flow schedule F(t), 0 <_ t £ t^ . The 
perturbed (two segment) delivery function is shown in Fig. E.2. 




Fig. E.2. Perturbed Delivery Function 
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Since (t) dominates D(t), the last cannot be an optimal 
delivery function. 

Following the same argument it can be shown that an optimal 
delivery function must be composed only of linear segments, 
i.e. it is not possible to have an optimal delivery function 
as shown in Fig. E.3. 




Fig. E.3. Mixed Type Optimal Delivery Function 

Basically, this completes our argument about piecewise 
linearity of optimal delivery functions. We note that in case 
the optimal solution to MTP (1) is not stable, the argument does 
not change significantly: 

Instead of (E.2) we write 



l a*(l,R) Aq* 

(i,k)eN 1 



(E . 5) 
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where 



R = {r* (t°) } , v (i,k) £ N 1 . 

The dual variables 0^(1, R), v(i,k) £ in (E.5) correspond 

to the related optimal dual solution for the perturbed problem 
k h 

(note, 0^(1, R) = 0 ^( 1 ), *(i,k) £ N^ if the original solution 
is stable) . All other properties remain as before. 

We summarize our discussion with the following theorem. 

Theorem E.l 

An optimal delivery function is piecewise linear. 



F. ON THE NUMBER OF CORNER POINTS 

In Chapter III.B.2 we proposed a conjecture (Conjecture 
III.l) which upper-bounds the number of corner points of an 
optimal delivery function with |Nq|, the number of non-zero 
data queues. The conjecture is based on one aspect of our 
experience with delivery problems, the essence of which may be 
formalized as follows. 

Proposition F.l 

At a stable point, let K denote the number of commodities 
c m 

for which the dual variables at the m-th corner are equal to 
their maximal value or are negative, i.e., 

K = | { (i,k) : cj(m) = 0 m ( m) or 0* (m) < 0}|. 

m i ma x ± 
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then 




Conjecture III.l is a trivial consequence of Proposition 

F. l. Actually, we proved a related result (cf. Lemma IV. 5) 
which says that if = |Nq, for some m, then the delivery func- 
tion cannot be improved any more and thus is optimal. There 
seems to be a slight difficulty in proving the opposite direc- 
tion, i.e. that an optimal delivery function implies (at a 
stable point) equal dual variables. We must leave the proof 

of this conjecture and of Proposition F.l as open topics for 
further research. 

G. COMPUTER SOLUTION EXAMPLE OF OPTIMAL DELIVERY PROBLEM 




Cj^j = 1, *[i,j] e L Q 



q^(0) =70, 



q^ (0) =35, q^O) =50, q^O) =25, q^(0) =25, q^(0) =35. 



Fig. G.l. Optimal Delivery Problem 
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The problem in Fig. B.l was solved using the algorithm of 
Chapter III. We will not present the partial solutions in de- 
tail, but only the optimal flow schedule and its corresponding 
delivery function. The optimal flow schedule is composed of 
four segments, the chain flow decomposition of each is shown 
in the following figures. We append each segment with the 
relevant information obtained from the solution of the corres- 
ponding minimal time problem (recall that in our notation the 
"first" segment is (t^t^]). Also, we demonstrate the pertur- 
bation equation for each one of the flow segments. 

MTP(l): N x = { (1,5) , (2,4) , (3,1) , (3,5) } , 1^ = { [3,4] , [4,5] , 

[2,5] , [3,1]}, [(1) = (aj(l)=i,a2(l)=^,a3(l)=|, 
a 3 (1) 0 ' ' * * ' 0) 




Fig. G.la. Chain Flow Decomposition for t £ (50,51.25] 
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MTP ( 2 ) : 



1(2) = (o 5 1 (2)=l,o^(2)=l,o 1 3 (2)=2,o 5 3 (2)=2,0 l . . 

a t ( t)=-4) 





Fig. G.lb. 



Chain Flow Decomposition for t e (31.25,50] 



MTP ( 3) : N 3 = N 2 u {5,3 } L 3 = L 2 u { ( 2 , 3 ) , ( 5 , 3 ) } 

1(3) = (a^(3)=|,a 2 (3)=i,a 3 (3)=|,a 3 (3)=i-,0,...,0, 

a t (t) =-l . 5) 




Fig. G.lc. 



Chain Flow Decomposition for t e (25,31.25] 
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MTP (4 ) : N 4 = N 3 u {(4,2)}, L 4 = L 3 . { [1,2] , [1,4] , [4,2]} 

[(4) = (a^(4)=l,a2(4)=l,a 3 (4)=l ,a 3 (4)=l,a 3 (4)=l, 
a 4 (4)=l,0, . . . , 0 ,a t (4 ) =-5) 
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The corresponding optimal delivery function is shown in 
Fig. G.le. 




Fig. G.le. Optimal Delivery Function 

H. DETAILED SOLUTION OF THE MDDP EXAMPLE 
For completeness we restate the MDDP. 
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Fig. H.l. Maximally Delayed Decision Problem 



Optimal Flow Schedule : 1 
F 1 (k) : 

link period 

[ 1 , 2 ] 1 

" 2 

" 3 

[1,3] 1 

" 2 

" 3 



flow 

2 

2 

2 

0 

0 

0 



T We assume here that the starting time is k = 1, and not 
k = 0 as before. 
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